-- Logs begin at Thu 2022-05-26 17:07:15 UTC, end at Thu 2022-05-26 18:22:50 UTC. -- May 26 17:55:25.312771 dv-cinder-839064-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 17:55:25.321044 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:55:25 2022] *** May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: nodename: dv-cinder-839064-2-iscsi May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: machine: x86_64 May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: clock source: unix May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: pcre jit disabled May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: detected number of CPU cores: 4 May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: current working directory: / May 26 17:55:25.323351 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: detected binary path: /usr/bin/uwsgi-core May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: your processes number limit is 47680 May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: your memory page size is 4096 bytes May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: detected max file descriptor number: 2048 May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: lock engine: pthread robust mutexes May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: thunder lock: enabled May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 17:55:25.324067 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:55:25.367767 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: Python main interpreter initialized at 0x55ee0bd439c0 May 26 17:55:25.367767 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: python threads support enabled May 26 17:55:25.367767 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: your server socket listen backlog is limited to 100 connections May 26 17:55:25.367767 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: your mercy for graceful operations on workers is 90 seconds May 26 17:55:25.368200 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:55:25.368200 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: *** Operational MODE: preforking *** May 26 17:55:25.368453 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: *** uWSGI is running in multiple interpreter mode *** May 26 17:55:25.368453 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: spawned uWSGI master process (pid: 103405) May 26 17:55:25.368663 dv-cinder-839064-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 17:55:25.373357 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: spawned uWSGI worker 1 (pid: 103406, cores: 1) May 26 17:55:25.373357 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: spawned uWSGI worker 2 (pid: 103407, cores: 1) May 26 17:55:25.373357 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:55:26.585969 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:55:26.594447 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:55:27.317924 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:55:27.317924 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes May 26 17:55:27.318361 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:55:27.318361 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes May 26 17:55:27.322241 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:55:27.322241 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes May 26 17:55:27.322573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:55:27.322573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes May 26 17:55:29.949885 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:55:29.950600 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:55:29.950600 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:55:29.951029 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:55:29.951130 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:55:29.951212 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:55:29.951300 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:55:29.951398 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:55:29.951492 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:55:29.951584 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:55:29.951852 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.951952 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952179 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952268 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952502 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952600 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952822 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.952915 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953153 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953258 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953462 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953555 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953788 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.953890 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954110 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954260 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954472 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954571 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954732 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.954831 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955052 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955164 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955372 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839064-2-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955470 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839064-2-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955693 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955794 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.955998 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956102 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956309 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956450 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956624 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956769 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.956928 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.957071 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.957249 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.957391 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.957554 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.957696 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.958047 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.959530 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.959530 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.959932 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.960132 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.960332 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.960520 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.960715 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.960909 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.961122 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.961303 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.961507 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.961685 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.961880 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.962074 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.962270 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.962487 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.962698 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.962914 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963072 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963250 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963465 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963662 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839064-2-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963841 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839064-2-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.963841 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964185 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964185 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964487 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964671 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964804 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.964804 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.965092 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.965222 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.965355 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966080 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966261 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966390 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966521 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966648 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966779 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.966917 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967098 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967255 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967411 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967583 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967718 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967853 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.967985 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968122 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968255 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968386 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968527 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968654 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.968925 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969051 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969180 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969318 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969444 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969579 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969710 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.969889 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970053 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970216 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970344 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970602 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970727 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.970868 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971002 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971128 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971265 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971393 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971534 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971675 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971812 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.971949 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972075 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972208 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972347 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972485 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972619 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972751 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.972876 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973010 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973148 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973406 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973538 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973662 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.973869 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974007 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974138 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974305 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974443 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974577 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974715 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974847 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.974973 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975101 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975226 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975359 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975493 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975617 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975745 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.975869 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976014 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976220 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976363 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976488 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976612 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976745 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.976870 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977000 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977139 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977270 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977395 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977517 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977640 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977776 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.977901 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978025 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978155 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978309 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978435 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978576 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978709 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978841 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.978966 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979089 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979219 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979352 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979476 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979476 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979718 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979718 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.979965 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980111 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980239 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980370 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980502 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980633 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980767 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.980899 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.981023 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.981834 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.981967 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982091 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982263 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982393 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982518 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982518 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982759 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.982881 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983014 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983140 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983263 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983387 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983509 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983640 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983778 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.983909 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984040 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984164 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984286 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984416 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984549 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984673 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984796 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.984925 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985049 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985186 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985311 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985434 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985566 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985694 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985827 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.985968 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986101 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986379 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986531 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986658 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986789 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.986920 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987057 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987188 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987455 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987648 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987789 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.987961 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988104 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988269 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988398 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988590 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988730 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.988902 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989038 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989211 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989347 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989514 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989651 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989822 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.989956 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990127 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990299 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990460 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990599 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990765 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.990895 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991199 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991373 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991513 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991676 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991807 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.991979 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992108 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992284 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992414 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992585 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992722 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.992890 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993017 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993194 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993324 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993505 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993639 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993812 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.993948 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994122 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994327 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994454 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994577 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994758 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.994898 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.995080 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:55:29.995211 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.995423 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.995552 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.995734 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.995870 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996067 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996185 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996402 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996525 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996748 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.996898 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997063 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997378 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997505 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997699 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.997842 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998009 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998137 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998345 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998463 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998655 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.998965 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999101 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999278 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999405 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999613 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999768 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:29.999908 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000046 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000209 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000337 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000528 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000657 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000839 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.000974 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001158 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001288 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001471 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001608 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001794 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.001930 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002105 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002299 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002469 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002608 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002787 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.002916 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003114 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003241 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003438 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003567 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003765 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.003902 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004085 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004222 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004396 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004531 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004705 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.004833 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005018 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005159 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005334 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005472 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005653 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.005788 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006015 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006155 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006303 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006443 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006666 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006794 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.006916 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007049 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007337 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007530 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007655 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007797 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.007932 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008078 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008213 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008342 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008478 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008622 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008764 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.008889 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009039 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009167 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009353 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009486 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009687 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009835 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.009971 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010110 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010283 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010420 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010560 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010688 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.010869 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011011 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011176 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011542 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011721 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011855 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.011995 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.012124 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.012279 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.012462 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.012727 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.012869 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013049 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013191 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013344 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013493 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013667 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.013927 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014056 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014234 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014378 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014506 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014630 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014753 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.014887 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015019 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015154 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015286 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015467 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015597 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015776 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.015915 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016081 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016224 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016403 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016539 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016765 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.016912 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017036 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017167 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017293 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017418 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017603 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017743 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.017911 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018051 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018238 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018373 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018554 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018697 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.018874 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019006 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019189 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019502 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019633 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019826 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.019957 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020147 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020277 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020451 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020580 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020773 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.020902 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021097 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021235 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021404 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021540 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021706 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.021831 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022014 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022145 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022487 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022619 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022745 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.022875 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023002 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023135 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023262 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023386 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023510 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023635 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023802 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.023941 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024104 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024232 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024405 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024543 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024707 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.024845 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025157 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025334 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025463 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025635 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025775 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.025936 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026066 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026258 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026390 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026573 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026709 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.026884 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027018 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027196 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027541 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027672 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.027850 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.028561 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.028767 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.028935 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029079 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029214 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029347 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029476 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029660 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029791 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.029976 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030107 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030326 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030473 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030641 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030780 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.030955 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031084 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031268 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031398 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031585 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031726 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.031910 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032037 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032223 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032350 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032535 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032659 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032847 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.032977 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033151 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033299 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033467 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033616 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033789 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.033928 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.034131 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.034296 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.034472 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.034873 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035058 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035188 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035372 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035501 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035685 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035817 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.035993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036133 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036303 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036433 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036612 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036743 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.036921 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037162 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037300 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037426 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037559 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037692 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037818 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.037943 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038133 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038307 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038475 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038612 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038783 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.038910 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039095 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039228 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039392 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039522 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039705 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.039834 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040024 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040161 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040335 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040465 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040647 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040783 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.040958 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041097 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041280 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041416 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041592 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041721 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.041901 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042039 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042229 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042362 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042541 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042670 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042847 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.042978 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.043158 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.043286 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.043468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.043652 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.044354 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.044486 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.044668 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.044859 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.044990 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.045233 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.045372 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.045554 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.045684 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.045869 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046062 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046237 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046381 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046508 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046632 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046821 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.046949 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047129 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047276 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047442 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047549 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047763 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.047859 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048077 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048174 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048379 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048478 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048683 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048778 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.048999 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049100 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049304 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049408 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049609 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049705 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.049914 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050013 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050234 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050344 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050546 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050648 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050854 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.050958 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051170 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051266 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051484 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051594 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051794 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.051903 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052096 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052414 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052587 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052723 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.052810 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053031 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053125 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053341 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053442 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053651 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053745 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.053973 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.054071 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.054296 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.054432 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.054620 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.054938 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.055157 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.055372 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.055629 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.055847 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.055847 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056129 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056129 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056374 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056631 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056784 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.056990 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.057147 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.057482 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.057642 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.057821 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058007 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058149 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058329 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058329 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058628 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.058878 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059384 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059567 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059722 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059850 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059979 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.059979 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.060401 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.060616 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.060843 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.061073 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.061291 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.061504 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.061722 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.061948 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.062180 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.062479 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.062657 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.062766 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.062930 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063080 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063216 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063346 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063493 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063598 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063739 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.063875 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064021 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064160 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064267 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064402 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064561 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064718 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.064867 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065000 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065149 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065287 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065428 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065570 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065712 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065846 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.065997 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066134 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066302 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066440 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066531 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066662 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066800 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.066935 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067065 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067212 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067305 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067384 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067608 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067744 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067888 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.067979 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068110 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068265 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068404 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068540 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068683 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068818 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.068953 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069097 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069233 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069371 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069516 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069662 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069805 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.069941 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070075 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070225 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070370 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070506 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070651 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070789 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.070935 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071072 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071162 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071334 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071486 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071625 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071762 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.071899 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072030 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072175 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072313 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072450 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072587 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072724 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.072860 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073009 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073155 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073305 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073445 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073584 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073675 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073814 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.073949 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.074081 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.074180 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.074436 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.074573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.074573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075311 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075389 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075535 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075670 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075803 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.075950 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076088 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076226 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076402 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076540 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076764 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.076901 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077040 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077178 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077310 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077455 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077615 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077702 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.077927 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078065 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078253 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078390 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078541 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078681 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078848 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.078988 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079163 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079311 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079455 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079598 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079743 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.079878 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080044 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080351 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080489 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080655 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080792 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.080958 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081099 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081266 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081404 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081570 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081711 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.081877 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082024 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082158 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082323 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082494 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082635 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082798 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.082945 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083084 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083231 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083389 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083523 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083696 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083843 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.083980 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084124 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084270 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084407 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084713 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.084878 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085013 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085161 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085299 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085475 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085628 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085762 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.085894 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086066 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086249 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086395 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086538 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086679 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.086808 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087006 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087163 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087301 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087442 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087589 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087726 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.087957 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088120 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088263 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088400 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088537 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088683 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088829 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.088987 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089126 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089265 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089439 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089594 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089734 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.089880 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.090043 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.090215 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.090376 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091075 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091283 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091475 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091694 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091853 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.091991 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092130 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092276 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092424 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092563 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092733 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.092881 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093048 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093205 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093378 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093526 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093678 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093816 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.093995 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094150 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094340 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094489 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094630 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094768 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.094914 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095053 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095213 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095360 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095505 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095654 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095807 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.095948 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096093 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096231 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096404 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096551 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096698 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.096837 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097008 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097160 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097305 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097455 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097614 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097755 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.097893 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098057 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098310 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098425 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098514 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098597 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098813 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.098903 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099115 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099225 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099421 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099742 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.099844 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100034 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100134 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100344 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100446 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100664 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100758 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.100973 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101073 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101285 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101388 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101592 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101693 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.101950 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102037 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102284 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102380 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102615 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102702 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.102917 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103015 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103217 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103304 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103546 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103631 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103863 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.103952 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104181 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104267 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104488 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104574 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104806 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.104913 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105114 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105229 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105421 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105584 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105747 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.105913 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.106087 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.106273 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.106481 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.106635 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.106897 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107035 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107172 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107315 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107450 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107606 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107750 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.107986 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108129 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108275 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108486 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108626 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108800 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.108937 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109080 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109272 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109425 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109572 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109708 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.109881 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110309 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110447 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110623 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110761 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.110912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111172 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111324 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111462 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111620 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111778 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.111924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112068 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112219 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112357 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112501 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112645 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112782 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.112920 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113057 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113337 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113486 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113630 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113766 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.113937 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114079 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114285 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114421 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114612 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114752 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.114942 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115084 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115261 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115400 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115586 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115746 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.115900 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116110 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116249 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116384 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116521 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116664 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116800 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.116943 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117079 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117242 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117552 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117701 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117859 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.117997 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.118174 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.118370 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.118529 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.118731 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.118886 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119026 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119164 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119310 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119462 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119610 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119752 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.119891 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120029 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120167 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120304 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120451 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120590 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120730 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.120867 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121012 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121177 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121399 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121543 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121708 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.121855 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122141 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122327 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122470 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122619 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122759 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.122897 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123036 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123183 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123323 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123472 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123653 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123799 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.123963 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124120 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124260 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124399 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124561 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124707 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.124912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125059 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125206 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125344 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125527 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125676 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.125862 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126011 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126176 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126363 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126505 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126643 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126825 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.126974 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127114 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127252 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127423 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127570 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127717 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.127856 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128024 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128172 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128332 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128489 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128630 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128776 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.128925 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129064 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129225 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129390 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129671 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129809 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.129947 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130122 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130307 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130494 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130665 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130814 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.130954 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131092 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131240 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131410 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131639 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131786 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.131926 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132073 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132213 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132353 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132503 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132737 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132888 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.132888 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133163 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133303 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133453 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133619 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133799 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.133951 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134091 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134091 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134409 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134550 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134688 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134839 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.134980 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135127 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135277 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135451 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135600 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.135887 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136167 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136305 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136453 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136609 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136761 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.136918 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.137059 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.137223 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.137902 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.138351 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.138503 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.138503 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.138778 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.138918 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.139115 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.139342 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.139611 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.139760 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.140098 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.140255 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.140527 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.140684 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.140846 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.141070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.141218 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.141461 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.141626 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.141861 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.142008 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.142147 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.142408 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.142573 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.142733 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143021 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143170 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143333 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143593 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143754 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.143978 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.144154 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.144301 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.144634 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.144790 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.144939 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.145262 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.145417 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.145583 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.145883 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.146041 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.146770 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.146918 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147059 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147059 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147420 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147560 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147714 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147854 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.147993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148141 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148280 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148419 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148556 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148694 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148832 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.148982 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149123 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149261 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149410 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149556 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149705 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149844 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.149982 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150129 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150293 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150434 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150587 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150728 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.150866 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151004 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151143 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151302 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151443 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151582 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151728 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.151885 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152097 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152268 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152411 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152549 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152692 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.152864 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.153068 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.153830 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.153980 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154156 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154352 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154494 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154633 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154792 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.154932 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.155109 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.155264 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.155559 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.155717 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.155866 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156016 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156155 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156301 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156469 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156626 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156765 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.156912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157080 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157226 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157407 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157568 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157708 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.157856 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158018 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158165 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158408 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158560 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158700 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.158839 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.159038 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.159185 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.159332 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.159530 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.159939 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160116 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160429 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160583 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160763 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.160911 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161084 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161245 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161391 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161627 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161777 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.161980 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162233 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162383 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162547 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162690 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162836 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.162976 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163115 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163253 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163405 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163545 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163683 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163830 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.163971 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164110 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164267 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164407 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164546 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164684 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164824 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.164994 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165155 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165328 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165475 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165635 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165789 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.165939 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166078 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166272 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166419 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166558 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166696 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166846 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.166988 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167133 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167272 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167417 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167565 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167712 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.167859 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.168024 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.168184 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.168322 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.168459 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.169121 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.169861 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170011 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170150 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170335 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170496 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170637 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170784 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.170925 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171064 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171215 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171365 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171506 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171652 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171793 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.171933 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172072 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172238 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172451 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172596 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172735 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.172875 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173022 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173198 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173481 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173619 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173758 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.173896 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174048 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174256 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174406 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174547 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174784 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.174943 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175095 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175236 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175406 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175553 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175720 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.175882 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176071 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176224 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176369 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176508 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176692 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.176912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177060 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177245 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177394 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177565 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177796 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.177939 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178078 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178257 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178404 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178544 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178691 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178839 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.178978 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179124 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179274 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179413 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179561 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179724 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.179871 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180035 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180190 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180330 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180478 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180640 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180794 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.180934 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181081 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181229 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181368 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181539 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181687 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181848 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.181996 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.182143 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.182319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.182477 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.182688 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.182845 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183003 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183293 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183440 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183580 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183719 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.183866 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184006 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184168 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184384 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184535 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184676 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184824 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.184974 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185113 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185254 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185392 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185531 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185678 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.185819 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186010 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186159 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186377 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186531 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186672 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186831 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.186971 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187110 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187285 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187442 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187612 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187761 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.187936 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188083 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188251 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188413 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188575 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188722 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.188871 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189009 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189206 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189354 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189549 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189695 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.189868 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190015 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190162 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190336 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190488 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190727 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.190891 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191031 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191185 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191324 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191462 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191600 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191746 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.191893 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192033 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192173 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192467 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192621 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.192856 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193004 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193143 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193281 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193427 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193567 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193714 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.193862 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194002 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194141 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194320 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194473 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194633 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194774 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.194913 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195059 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195200 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195348 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195496 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195781 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.195921 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196067 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196215 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196365 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196525 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196666 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196803 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.196950 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197098 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197238 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197384 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197524 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197662 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197801 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.197947 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198087 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198267 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198426 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198566 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198711 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.198857 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199004 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199143 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199281 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199428 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199577 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.199716 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.200485 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.200647 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.200799 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.200940 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.201331 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.201643 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.201785 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.201923 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.202089 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.202266 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.202425 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.202665 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.202871 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203018 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203157 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203319 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203470 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203618 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203758 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.203902 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204041 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204361 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204508 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204655 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204795 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.204971 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205133 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205284 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205423 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205561 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205699 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.205859 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206015 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206173 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206396 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206543 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206689 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.206916 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207066 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207232 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207395 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207547 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207692 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207848 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.207995 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208141 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208286 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208431 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208585 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208740 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.208888 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209044 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209198 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209344 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209499 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209646 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209791 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.209936 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210081 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210250 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210416 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210572 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210719 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.210871 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211028 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211174 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211329 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211482 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211783 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.211928 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212083 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212230 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212376 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212520 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212665 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212820 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.212979 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.213126 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.213271 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.213416 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.213588 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.213742 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:55:30.213897 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.214263 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.214553 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.214859 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:55:30.215103 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:55:30.277703 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Registered counter for database nova_api May 26 17:55:30.278707 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Registered counter for database nova_api May 26 17:55:30.301037 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.302796 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.307863 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.309476 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.365875 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.context [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b0db0dc-c451-4016-9cfb-3e1d6c7c5950(cell1) {{(pid=103407) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:55:30.368696 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.context [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b0db0dc-c451-4016-9cfb-3e1d6c7c5950(cell1) {{(pid=103406) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:55:30.370068 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:55:30.372286 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:55:30.373170 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:55:30.373447 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:55:30.375067 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:55:30.375204 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:55:30.375857 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:55:30.377191 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Registered counter for database nova_cell0 May 26 17:55:30.377827 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:55:30.379884 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Registered counter for database nova_cell0 May 26 17:55:30.381306 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Registered counter for database nova_cell1 May 26 17:55:30.383926 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Registered counter for database nova_cell1 May 26 17:55:30.389350 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.390155 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.392289 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.395147 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.395766 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.398711 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.542656 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.551811 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.552985 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Registered counter for database nova_cell0 May 26 17:55:30.561243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Registered counter for database nova_cell0 May 26 17:55:30.562011 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.567050 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.570676 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:55:30.575290 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:55:30.916646 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:55:30.920228 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:55:30.924140 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:55:30.927529 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:55:31.269802 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:55:31.276164 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:55:31.277014 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:55:31.281606 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee0bd439c0 pid: 103406 (default app) May 26 17:55:31.283562 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-6382c255-2240-4e08-a863-16b3295ceefc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:55:31.283898 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:31.285429 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002206 May 26 17:55:31.285861 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Thu May 26 17:55:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:55:31.289337 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee0bd439c0 pid: 103407 (default app) May 26 17:56:51.946763 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:56:51.948346 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003889 May 26 17:56:51.952099 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:56:51.967517 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:51.968944 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:51.969705 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:51.970537 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:52.445901 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dec070fb-4eb5-4c6e-9f00-0e5e9e533d50 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:56:52.476533 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dec070fb-4eb5-4c6e-9f00-0e5e9e533d50 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.519747 May 26 17:56:52.477356 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 26 17:56:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:56:54.812075 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:56:54.813633 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-897baca2-2a7c-4833-b39c-6016082b3744 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 May 26 17:56:54.818521 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:56:54.877350 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-14665a8b-815a-4711-b348-f2d77cc10d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "rxtx_factor": 1.0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:56:54.896842 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:56:54.896842 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: warnings.warn(msg) May 26 17:56:54.929255 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-14665a8b-815a-4711-b348-f2d77cc10d08 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108749 May 26 17:56:54.930365 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:56:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:56:54.943891 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:54.945293 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:54.946508 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:54.948109 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:55.163792 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b5212f21-9fe9-4383-bbf6-ece77fbe0fcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:56:55.167068 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:56:55.167068 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 17:56:55.235573 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-b5212f21-9fe9-4383-bbf6-ece77fbe0fcb admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297006 May 26 17:56:55.236153 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 26 17:56:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:56:57.602854 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-14665a8b-815a-4711-b348-f2d77cc10d08 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:56:57.604993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-14665a8b-815a-4711-b348-f2d77cc10d08 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 May 26 17:56:57.609723 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:56:57.723221 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-bf62f35b-5a31-40c6-9d6b-c8b569c38e88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 5, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:56:57.741433 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:56:57.741433 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 17:56:57.762015 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-bf62f35b-5a31-40c6-9d6b-c8b569c38e88 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144713 May 26 17:56:57.762965 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:56:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:56:57.775108 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-33a839af-15e8-4318-8be0-14783bd7a93f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:56:57.777183 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:56:57.777183 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: warnings.warn(msg) May 26 17:56:57.813308 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-33a839af-15e8-4318-8be0-14783bd7a93f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042282 May 26 17:56:57.813905 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 26 17:56:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:57:00.144448 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-bf62f35b-5a31-40c6-9d6b-c8b569c38e88 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:00.145473 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-bf62f35b-5a31-40c6-9d6b-c8b569c38e88 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 26 17:57:00.145872 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:00.211725 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5600581b-78a0-431e-b217-2ffb158a2d62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:00.233286 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5600581b-78a0-431e-b217-2ffb158a2d62 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079322 May 26 17:57:00.234028 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:57:00.245674 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-59db7a86-6b0f-4c81-9353-b468b83c660a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:00.271555 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-59db7a86-6b0f-4c81-9353-b468b83c660a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029557 May 26 17:57:00.272489 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 26 17:57:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:57:02.558534 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5600581b-78a0-431e-b217-2ffb158a2d62 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:02.559565 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5600581b-78a0-431e-b217-2ffb158a2d62 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 May 26 17:57:02.560009 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:02.624912 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e8eb917-31f0-496c-9c49-63a47981a2be admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:02.644779 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-0e8eb917-31f0-496c-9c49-63a47981a2be admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077854 May 26 17:57:02.645467 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:02.659152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5c0d3fc7-e354-4679-bc8d-ddcaea4b84e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:02.685838 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5c0d3fc7-e354-4679-bc8d-ddcaea4b84e5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030681 May 26 17:57:02.686608 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 26 17:57:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:57:05.025925 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e8eb917-31f0-496c-9c49-63a47981a2be admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:05.027082 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-0e8eb917-31f0-496c-9c49-63a47981a2be admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 May 26 17:57:05.027769 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:05.090469 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "id": "d4", "ram": 4096}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:05.113417 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078469 May 26 17:57:05.115183 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:05.131125 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-1c298156-f6c9-426d-8159-d57882f93d72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:05.159738 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-1c298156-f6c9-426d-8159-d57882f93d72 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032171 May 26 17:57:05.160646 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Thu May 26 17:57:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:57:07.514373 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:07.515459 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 May 26 17:57:07.517359 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:07.583949 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b999873d-6dae-4d25-b4ad-3ce5ef4f3201 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:07.611629 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-b999873d-6dae-4d25-b4ad-3ce5ef4f3201 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088280 May 26 17:57:07.612793 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 26 17:57:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:10.206710 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:10.207740 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-83e56f56-93e4-4369-a9cc-42c4f8557f0d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 26 17:57:10.208150 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:10.270645 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-81e44ae9-0c8b-47da-8a20-ecbe6edf1c28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "vcpus": 1}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:10.289272 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-81e44ae9-0c8b-47da-8a20-ecbe6edf1c28 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074392 May 26 17:57:10.289864 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:10.302348 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f3ed41fc-f0e5-442c-b708-f450513a1716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:10.328311 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f3ed41fc-f0e5-442c-b708-f450513a1716 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029892 May 26 17:57:10.328917 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 26 17:57:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:57:12.605762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-81e44ae9-0c8b-47da-8a20-ecbe6edf1c28 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:12.606855 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-81e44ae9-0c8b-47da-8a20-ecbe6edf1c28 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 26 17:57:12.607263 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:57:12.672607 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b994a6f5-61eb-4b33-8e8d-c446afa1e17f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:12.696014 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b994a6f5-61eb-4b33-8e8d-c446afa1e17f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082379 May 26 17:57:12.696943 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:57:12.709159 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-20ac5f95-1fe6-4900-9400-5046d649fee9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:12.732800 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-20ac5f95-1fe6-4900-9400-5046d649fee9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027419 May 26 17:57:12.733330 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 26 17:57:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:57:15.515745 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b994a6f5-61eb-4b33-8e8d-c446afa1e17f admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:15.516789 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b994a6f5-61eb-4b33-8e8d-c446afa1e17f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 26 17:57:15.517188 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:15.583606 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a1d48fc0-4322-43b6-9c49-b39b1eda61f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:15.602674 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a1d48fc0-4322-43b6-9c49-b39b1eda61f4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078673 May 26 17:57:15.603980 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:57:15.616194 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5bf76afd-847c-4a2f-9e46-a90d129fcf2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:15.638740 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5bf76afd-847c-4a2f-9e46-a90d129fcf2d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026111 May 26 17:57:15.639325 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 26 17:57:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:57:17.953946 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a1d48fc0-4322-43b6-9c49-b39b1eda61f4 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:17.954999 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a1d48fc0-4322-43b6-9c49-b39b1eda61f4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 26 17:57:17.955404 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:18.014284 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-cb420067-48eb-4888-8a72-caf07251dc55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:18.038986 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-cb420067-48eb-4888-8a72-caf07251dc55 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077720 May 26 17:57:18.042218 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:18.052495 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-4e557a8a-ec5c-4fd6-9077-16b7ca8be0e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:18.076719 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-4e557a8a-ec5c-4fd6-9077-16b7ca8be0e4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027952 May 26 17:57:18.077668 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 26 17:57:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:57:20.429945 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-cb420067-48eb-4888-8a72-caf07251dc55 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:20.431950 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-cb420067-48eb-4888-8a72-caf07251dc55 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002401 May 26 17:57:20.442824 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:20.501870 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "disk": 160}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:20.528412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089389 May 26 17:57:20.541386 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f4cfbcec-4273-4a4e-92aa-e298a0b48850 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:20.550501 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Thu May 26 17:57:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:20.575134 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f4cfbcec-4273-4a4e-92aa-e298a0b48850 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037452 May 26 17:57:20.594349 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Thu May 26 17:57:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:57:45.007175 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:45.008181 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 26 17:57:45.008610 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:45.019403 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:45.073682 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ffc517f5-0ca7-4b53-bf4b-5e53fe23df94 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:45.091616 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ffc517f5-0ca7-4b53-bf4b-5e53fe23df94 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076724 May 26 17:57:45.092163 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 26 17:57:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:46.107482 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:46.108488 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e2815d5d-bc49-4494-a515-049d09f376d9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 26 17:57:46.108884 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:46.331665 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-27fe52da-eb38-4e95-8c63-3eb63880d8b5 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:46.337950 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-27fe52da-eb38-4e95-8c63-3eb63880d8b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-27fe52da-eb38-4e95-8c63-3eb63880d8b5 admin admin] Request method failure captured: May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept: application/json May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Connection: keep-alive May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Content-Length: 0 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Host: 10.222.0.76 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABij7-aJxixNaqFE0kieOdQtKgYtf6ZpH9XNzuD5y-lXjhOmXCppBxknU75_q7kAt249wMvt8XfTh0yT3UBRZwkmL0B2NadFsITHsWLZmi5aSBPT39eca5xUgkFnDgEDxiI6VaFCXIJijfG9b9w1TJm1qal56AwQXrlFwhNP2avee1J8A8 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Id: None May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Name: None May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Name: admin May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member May 26 17:57:46.341243 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant: admin May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User: admin May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Name: admin May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: method: > May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: exception: Flavor 42 could not be found. May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: action_args: {'id': '42'} May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:46.342924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:46.343886 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:46.345152 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-27fe52da-eb38-4e95-8c63-3eb63880d8b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:46.346266 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-27fe52da-eb38-4e95-8c63-3eb63880d8b5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063354 May 26 17:57:46.346266 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 26 17:57:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:57:46.353279 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-351b2467-24bd-4751-adc6-06fa8e397c09 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:46.356286 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:46.375908 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-351b2467-24bd-4751-adc6-06fa8e397c09 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026793 May 26 17:57:46.376482 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:46.386708 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-7c8bd488-3c72-414a-aa7e-d13a0c600848 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:46.409257 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-7c8bd488-3c72-414a-aa7e-d13a0c600848 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026404 May 26 17:57:46.409825 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:46.420325 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5e54d763-dbfa-4678-997b-bc21df59252c admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:46.426083 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-5e54d763-dbfa-4678-997b-bc21df59252c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5e54d763-dbfa-4678-997b-bc21df59252c admin admin] Request method failure captured: May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept: application/json May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Connection: keep-alive May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Content-Length: 0 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Host: 10.222.0.76 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABij7-aJxixNaqFE0kieOdQtKgYtf6ZpH9XNzuD5y-lXjhOmXCppBxknU75_q7kAt249wMvt8XfTh0yT3UBRZwkmL0B2NadFsITHsWLZmi5aSBPT39eca5xUgkFnDgEDxiI6VaFCXIJijfG9b9w1TJm1qal56AwQXrlFwhNP2avee1J8A8 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Id: None May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Name: None May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Name: admin May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Role: reader,admin,member May 26 17:57:46.429412 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Roles: reader,admin,member May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant: admin May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User: admin May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Name: admin May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: method: > May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: exception: Flavor 42 could not be found. May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: action_args: {'id': '42'} May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:46.431308 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:46.432468 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:46.433762 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5e54d763-dbfa-4678-997b-bc21df59252c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:46.435033 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5e54d763-dbfa-4678-997b-bc21df59252c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014467 May 26 17:57:46.435033 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 26 17:57:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:57:47.312709 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-7c8bd488-3c72-414a-aa7e-d13a0c600848 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:47.313746 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-7c8bd488-3c72-414a-aa7e-d13a0c600848 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 26 17:57:47.314133 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:47.513793 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-09b9720c-a03a-44a8-ab6d-934643106c6a admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:47.519640 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-09b9720c-a03a-44a8-ab6d-934643106c6a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-09b9720c-a03a-44a8-ab6d-934643106c6a admin admin] Request method failure captured: May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept: application/json May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Connection: keep-alive May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Content-Length: 0 May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Host: 10.222.0.76 May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABij7-bOiefY7Z3IN1qyOA7wx_2JZNj2GHfGif0gWUO0zRm8ISyaUu9nlWq3nSSldxgiEfaogaOvMI5EjaCiWWVNMUBMBk4HjJpeObnWA6lQXpDz_CjII04EMHlKOMnreTqoqkG1IX0UqAZqyv-ZFwYCxeBIjwRPdEibaZmwGzbhQxRRak May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Id: None May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Name: None May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Name: admin May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Role: reader,admin,member May 26 17:57:47.521193 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Roles: reader,admin,member May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant: admin May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User: admin May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Name: admin May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: method: > May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: exception: Flavor 84 could not be found. May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: action_args: {'id': '84'} May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:47.522785 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:47.523636 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:47.524714 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-09b9720c-a03a-44a8-ab6d-934643106c6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:47.525773 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-09b9720c-a03a-44a8-ab6d-934643106c6a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066308 May 26 17:57:47.525773 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 26 17:57:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:57:47.533665 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-06d8c254-a785-4d59-8450-c292a4613b12 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:47.549803 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-06d8c254-a785-4d59-8450-c292a4613b12 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019998 May 26 17:57:47.550404 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:47.561271 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-78362435-675a-497b-a00a-c2c5fae50209 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:47.575883 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-78362435-675a-497b-a00a-c2c5fae50209 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018542 May 26 17:57:47.576458 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:57:47.586241 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-37309cbd-c1f7-414c-bd6a-6cf783ed752d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:47.592213 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-37309cbd-c1f7-414c-bd6a-6cf783ed752d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-37309cbd-c1f7-414c-bd6a-6cf783ed752d admin admin] Request method failure captured: May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept: application/json May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Connection: keep-alive May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Content-Length: 0 May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Host: 10.222.0.76 May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABij7-bOiefY7Z3IN1qyOA7wx_2JZNj2GHfGif0gWUO0zRm8ISyaUu9nlWq3nSSldxgiEfaogaOvMI5EjaCiWWVNMUBMBk4HjJpeObnWA6lQXpDz_CjII04EMHlKOMnreTqoqkG1IX0UqAZqyv-ZFwYCxeBIjwRPdEibaZmwGzbhQxRRak May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Id: None May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Name: None May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Name: admin May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member May 26 17:57:47.593741 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant: admin May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User: admin May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Name: admin May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: method: > May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: exception: Flavor 84 could not be found. May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: action_args: {'id': '84'} May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:47.595281 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:47.596993 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:47.598070 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-37309cbd-c1f7-414c-bd6a-6cf783ed752d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:47.599144 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-37309cbd-c1f7-414c-bd6a-6cf783ed752d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012533 May 26 17:57:47.599144 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Thu May 26 17:57:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:57:48.492444 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-78362435-675a-497b-a00a-c2c5fae50209 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:48.494575 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-78362435-675a-497b-a00a-c2c5fae50209 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 May 26 17:57:48.494969 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:48.690424 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b0cb622d-e35a-4a6b-9bcb-0dbb8eb82a60 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:48.696389 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-b0cb622d-e35a-4a6b-9bcb-0dbb8eb82a60 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b0cb622d-e35a-4a6b-9bcb-0dbb8eb82a60 admin admin] Request method failure captured: May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept: application/json May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Connection: keep-alive May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Content-Length: 0 May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Host: 10.222.0.76 May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABij7-clOxYhoDmDxXt6u8s4OoofVhw0KhvJu0bFzcLFtbMEucQ-QeLiXKSEjJImysT-1lNRf_e7dDZxpVCMwo8SPKGYadT1gjF60nwP4WLY53nBUfYzK7i50BLtD8yW5eVSzVOGuDPkVqLr02Aoqn22LpedA_zprcCB0YQ7ehdq2Fz-EY May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Id: None May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Domain-Name: None May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Project-Name: admin May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member May 26 17:57:48.697912 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant: admin May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User: admin May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: X-User-Name: admin May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: method: > May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: exception: Flavor 451 could not be found. May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: action_args: {'id': '451'} May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:48.699341 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:48.700381 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi May 26 17:57:48.701532 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b0cb622d-e35a-4a6b-9bcb-0dbb8eb82a60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:48.702650 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b0cb622d-e35a-4a6b-9bcb-0dbb8eb82a60 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064189 May 26 17:57:48.702650 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 17:57:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:57:48.709001 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-87ecb7c3-b5d3-4256-ae67-322a0eebe91d admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:48.726758 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-87ecb7c3-b5d3-4256-ae67-322a0eebe91d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021241 May 26 17:57:48.728169 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:48.737450 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:48.751137 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017237 May 26 17:57:48.751667 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Thu May 26 17:57:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:48.760693 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5567ac06-a211-4649-b87b-371b5358c062 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:48.765981 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-5567ac06-a211-4649-b87b-371b5358c062 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5567ac06-a211-4649-b87b-371b5358c062 admin admin] Request method failure captured: May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept: application/json May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Connection: keep-alive May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Content-Length: 0 May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Host: 10.222.0.76 May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABij7-clOxYhoDmDxXt6u8s4OoofVhw0KhvJu0bFzcLFtbMEucQ-QeLiXKSEjJImysT-1lNRf_e7dDZxpVCMwo8SPKGYadT1gjF60nwP4WLY53nBUfYzK7i50BLtD8yW5eVSzVOGuDPkVqLr02Aoqn22LpedA_zprcCB0YQ7ehdq2Fz-EY May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Id: None May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Domain-Name: None May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Project-Name: admin May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Role: reader,admin,member May 26 17:57:48.767511 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Roles: reader,admin,member May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_5a106ee939504b208f8d5ca1deb61f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant: admin May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 5a106ee939504b208f8d5ca1deb61f2d May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User: admin May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Id: 3c37098f90fe47ab88491e90626539d9 May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: X-User-Name: admin May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: method: > May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: exception: Flavor 451 could not be found. May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: action_args: {'id': '451'} May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:57:48.769192 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:48.770058 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi May 26 17:57:48.771349 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5567ac06-a211-4649-b87b-371b5358c062 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:57:48.772573 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5567ac06-a211-4649-b87b-371b5358c062 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011695 May 26 17:57:48.772573 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 17:57:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:57:49.653500 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:49.654530 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 26 17:57:49.654924 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:49.843052 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e825439b-4507-460a-9119-cff8f883eb95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:49.861312 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e825439b-4507-460a-9119-cff8f883eb95 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071430 May 26 17:57:49.861790 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 26 17:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:50.771198 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:50.772209 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 26 17:57:50.772607 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:50.965758 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-8f51b7ac-2677-42b0-941e-9e4fb4b4fc82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:50.983379 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-8f51b7ac-2677-42b0-941e-9e4fb4b4fc82 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071910 May 26 17:57:50.983833 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 26 17:57:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:57:51.862350 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:51.863379 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 May 26 17:57:51.863783 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:52.057865 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-db637476-5c8b-4039-8b3b-a05f54fcb755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:52.075820 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-db637476-5c8b-4039-8b3b-a05f54fcb755 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071856 May 26 17:57:52.076370 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 26 17:57:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:57:52.949223 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:52.950273 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 26 17:57:52.950670 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:53.141144 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-7d6cc884-5fae-48e7-ac24-6102c171c2ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:57:53.159981 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-7d6cc884-5fae-48e7-ac24-6102c171c2ef admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071031 May 26 17:57:53.160454 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Thu May 26 17:57:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:54.028329 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:54.029329 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 26 17:57:54.029728 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 17:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:54.229775 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-205361bf-375a-4cff-9da9-087895918503 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:54.249731 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-205361bf-375a-4cff-9da9-087895918503 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082553 May 26 17:57:54.250231 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Thu May 26 17:57:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:58:58.296346 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.297346 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f11d3899-4696-4c68-afe1-5561e47cf11b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 26 17:58:58.297773 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:58:58.305782 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:58:58.357836 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2a9d30dc-1e5b-477e-843f-ca1f3f02bdfb admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.377958 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2a9d30dc-1e5b-477e-843f-ca1f3f02bdfb admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074265 May 26 17:58:58.378525 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:58:58.399330 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=14 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:58:58.403282 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-60853203-3ba1-4594-857a-258a9e245772 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.411589 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-60853203-3ba1-4594-857a-258a9e245772 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013814 May 26 17:58:58.412116 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:58:58.424068 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-ef1de885-07fd-4678-b600-15f6c252e906 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.432491 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-ef1de885-07fd-4678-b600-15f6c252e906 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012040 May 26 17:58:58.433012 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:58:58.444337 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.451938 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011260 May 26 17:58:58.452448 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:58:58.465019 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-1cca3089-db68-4492-82bb-0647bf471900 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:58:58.472926 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-1cca3089-db68-4492-82bb-0647bf471900 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011487 May 26 17:58:58.473448 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Thu May 26 17:58:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:35.159683 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.160716 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 26 18:02:35.161136 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 34/69] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 18:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:02:35.325622 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=6 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:35.458706 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.460302 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:02:35.460302 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 18:02:35.461604 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.462049 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.462874 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.463302 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.506556 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-6567e6ab-1175-443e-9a87-1a286ffd3026 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.181829 May 26 18:02:35.506822 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 36/70] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 18:02:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:02:36.422649 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:36.424336 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 May 26 18:02:36.424775 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 18:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:36.630132 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:36.631523 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:02:36.631523 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 18:02:36.632996 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:36.633479 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:36.634410 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:36.634945 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:36.655298 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-fc0497c3-fc1e-4761-8f4e-a6f06fe9f2c0 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087677 May 26 18:02:36.656149 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 18:02:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:02:48.089334 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:48.090372 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 26 18:02:48.090772 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 36/73] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 18:02:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:48.242064 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:48.242812 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:48.243461 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=8 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:48.299722 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:48.300955 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:02:48.300955 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 18:02:48.302691 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.303251 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.304142 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.304562 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.332025 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-dbe2319a-1ddb-45d7-ac58-090cc0c28108 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094384 May 26 18:02:48.332616 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 38/74] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 18:02:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:02:49.240040 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:49.241068 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71a591e1-80e2-4f41-8060-9ec4eaf6f997 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 26 18:02:49.241483 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 37/75] 10.222.0.76 () {56 vars in 1074 bytes} [Thu May 26 18:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:49.446739 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:49.449078 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:02:49.449078 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: warnings.warn(msg) May 26 18:02:49.451030 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.451609 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.452604 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.453064 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.476629 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-71264574-8329-46f9-8950-1514506a63e9 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093158 May 26 18:02:49.477220 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 39/76] 10.222.0.76 () {60 vars in 1193 bytes} [Thu May 26 18:02:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:48.099299 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: Thu May 26 18:03:48 2022 - graceful shutdown triggered... May 26 18:03:48.099404 dv-cinder-839064-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 18:03:48.101206 dv-cinder-839064-2-iscsi devstack@n-api.service[103406]: Gracefully killing worker 1 (pid: 103406)... May 26 18:03:48.102277 dv-cinder-839064-2-iscsi devstack@n-api.service[103407]: Gracefully killing worker 2 (pid: 103407)... May 26 18:03:49.102295 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: worker 1 buried after 1 seconds May 26 18:03:49.102295 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: worker 2 buried after 1 seconds May 26 18:03:49.102295 dv-cinder-839064-2-iscsi devstack@n-api.service[103405]: goodbye to uWSGI. May 26 18:03:49.103937 dv-cinder-839064-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 18:03:49.104767 dv-cinder-839064-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 18:03:49.108059 dv-cinder-839064-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 18:03:49.124495 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 18:03:49 2022] *** May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: nodename: dv-cinder-839064-2-iscsi May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: machine: x86_64 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: clock source: unix May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: pcre jit disabled May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: detected number of CPU cores: 4 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: current working directory: / May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: detected binary path: /usr/bin/uwsgi-core May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: your processes number limit is 47680 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: your memory page size is 4096 bytes May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: detected max file descriptor number: 2048 May 26 18:03:49.146613 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: lock engine: pthread robust mutexes May 26 18:03:49.148945 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: thunder lock: enabled May 26 18:03:49.148945 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 18:03:49.148945 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 18:03:49.195576 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: Python main interpreter initialized at 0x55a675c0e9c0 May 26 18:03:49.195576 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: python threads support enabled May 26 18:03:49.195576 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: your server socket listen backlog is limited to 100 connections May 26 18:03:49.195576 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: your mercy for graceful operations on workers is 90 seconds May 26 18:03:49.196178 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: mapped 403077 bytes (393 KB) for 2 cores May 26 18:03:49.196178 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: *** Operational MODE: preforking *** May 26 18:03:49.198014 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: *** uWSGI is running in multiple interpreter mode *** May 26 18:03:49.198014 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: spawned uWSGI master process (pid: 117821) May 26 18:03:49.198014 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: spawned uWSGI worker 1 (pid: 117832, cores: 1) May 26 18:03:49.198014 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: spawned uWSGI worker 2 (pid: 117833, cores: 1) May 26 18:03:49.198014 dv-cinder-839064-2-iscsi devstack@n-api.service[117821]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 18:03:49.196556 dv-cinder-839064-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 18:03:50.521371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:03:50.539691 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:03:51.340532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:03:51.340532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes May 26 18:03:51.340857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:03:51.340857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes May 26 18:03:51.577750 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:03:51.577750 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes May 26 18:03:51.578698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:03:51.578698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes May 26 18:03:53.858810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:03:53.859409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:03:53.859708 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:03:53.859999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:03:53.860260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:03:53.860664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.860999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.861957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.862431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.862782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.863099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.863433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.863762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.864103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.864373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.864698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.865032 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839064-2-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.865365 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.865685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.866007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.866371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.866684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.867014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.867328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.867841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.868611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.869206 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.870120 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.870703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.871205 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.871705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.872197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.872682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.873874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.874417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.875048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839064-2-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.875558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.876048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.876537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.877245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.878361 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.879074 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.879648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.880208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.880770 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.881387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.881976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.882564 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.883769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.884303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.884862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.885420 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.885977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.886538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.887086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.887563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.888100 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.888667 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.889223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.889767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.890272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.890759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.891324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.891882 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.892420 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.893122 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.893968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.894639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.895204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.895967 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.896593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.897117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.897663 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.898228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.898786 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.899320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.900596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.900979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.901318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.901766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.902221 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.902649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.903176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.903580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.903987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.904495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.905066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.905732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.906125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.906566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.906947 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.907399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.907920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.908330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.908740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.909123 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.909516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.909905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.910329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.910847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.911170 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.911494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.911846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.912137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.912457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.912777 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.913097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.913419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.913758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.914089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.914441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.914752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.915234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.915551 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.915889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.916198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.916513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.916848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.917171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.917476 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.917801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.918117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.918473 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.918798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.919106 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.919424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.919746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.920059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.920386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.920692 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.921002 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.921311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.921621 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.921929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.922269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.922576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.922905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.923233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.923552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.924457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.925043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.925577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:53.925932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.926309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.926668 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.926994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.927336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.927680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.928006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.928326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.928650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.929010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.929303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.929623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.929939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.930299 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.930635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.930974 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.931303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.931630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.931957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.932275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.932621 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.933005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.933342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.933666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.934021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.934409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.934745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.935061 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.935397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.935804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.938256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.938256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.938256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.938703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.938875 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.939207 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.939616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.940550 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.940886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.941214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.941540 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.941916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.942303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.942639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.942967 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.943303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.943620 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.944272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.944602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.944914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.945409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.945732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.946058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.946401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.946738 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.947084 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.947393 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.947741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.948060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.948383 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.948702 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.949071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.949315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.949638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.949960 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.950520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.950840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.951096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.951484 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.951779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.952073 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.952269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.952892 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.952892 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.953397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.953731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.953994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.954326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.954562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.954858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.955736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.955736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.956155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.956155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.956562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.956824 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.957144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.957410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.957883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.958078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.958577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.958834 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.959132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.959380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.959624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.959908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.960141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.960461 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.960836 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.961153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.961468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.961855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.962180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.962568 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.962849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.963520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.963520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.964065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.964286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.964670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.964936 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.965174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.965574 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.965828 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.966115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.966454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.966867 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.967281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.967672 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.967969 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.968254 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.969065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.969065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.969603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.969603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.970065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.970478 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.971333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.971615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.971980 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.972513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.972840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.973164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.973833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.973833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.974423 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.974670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.974906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.975142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.975433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.975729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.976054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.976399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.976737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.977055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.977376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.977706 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.978024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.978369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.979141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.979141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.979646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.979646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.980086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.980305 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.980535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.980823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.981151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.981466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.981779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.982091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.982497 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.982798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.983117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.983455 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.984537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.984537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.984537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.985306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.985306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.985306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.986027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.986027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.987320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.987320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.988075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.988075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.988682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.988682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.989623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.989623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.989623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.990357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.990357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.990841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.990841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.991314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.991585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.991861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.992200 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.992517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.992836 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.993649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.993649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.994604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.994604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.995101 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.995101 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.995536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.995811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.996063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.996304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.996580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.997098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.997341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.997561 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.997960 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.998272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.998525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.998957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.999799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:53.999799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.000269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.001306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.001306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.001306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.001306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.002182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.002182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.002182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.002851 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.002851 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.003343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.003551 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.003899 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.004172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.004489 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.005191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.005191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.005649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.005914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.006117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.006455 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.006769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.007103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.007415 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.007725 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.008034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.008352 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.008670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.008979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.009298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.009998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.009998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.010487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.010719 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.010929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.011149 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.011509 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.011843 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.012103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.012418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.012737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.013151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.013378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.013661 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.013975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.014650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.014650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.015438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.015438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.015848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.015996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.016193 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.016649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.016888 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.017197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.017842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.018039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.018532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.019002 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.019370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.019809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.020135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.020451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.020776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.021093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.021410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.021721 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.022038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.022388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.022701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.023013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.023326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.023633 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.024000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.024318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.024631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.025009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.025258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.025654 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.025968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.026368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.026682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.027006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.027338 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.027662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.028015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.028341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.028656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.028977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.029292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.029628 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.029923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.030260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.030860 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.031178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.031495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.031826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.032157 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.032488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.032802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.033646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.033975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.034321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.034641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.034953 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.035273 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.035591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.035910 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.036227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.036546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.036861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.037179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.037495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.037806 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.038144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.038487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.038804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.039118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.039428 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.039745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.040057 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.040511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.040829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.041185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.041477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.041793 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.042109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.042458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.042784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.043108 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.043553 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.043874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.044194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.044515 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.044822 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.045130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.045447 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.045780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.046099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.046439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.046751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.047080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.047390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.047716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.048151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.048475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.048858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.049778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.050095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.050475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.050882 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.051232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.051648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.051937 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.052242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.052492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.052847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.053178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.053493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.053825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.054146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.054516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.054822 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.055159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.055712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.055976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.056297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.056624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.056952 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.057286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.057641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.057955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.058302 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.058616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.058929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.059261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.059572 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.059890 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.061928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.062695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.062695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.062695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.063395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.063395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.063873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.064109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.064402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.064734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.065194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.065555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.065856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.066957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.066957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.066957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.067704 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.067704 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.068169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.068169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.068619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.068865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.069105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.069355 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.069676 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.069987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.070355 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.070609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.070923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.071232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.071546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.071855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.072186 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.072494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.072817 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.073133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.073441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.073750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.074049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.074431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.074743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.075085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.075460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.075763 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.076100 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.076416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.076758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.077077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.077400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.077716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.078042 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.078372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.078701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.079020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.079335 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.079660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.080019 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.080408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.081003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.081327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.081650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.081957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.082300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.082625 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.082943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.083261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.083592 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.083939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.084209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.084553 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.084885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.085220 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.085566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.085895 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.086324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.086596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.086877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.087248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.087567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.087880 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.088200 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.088523 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.088844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.089162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.089478 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.089800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.090122 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.090473 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.090790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.091110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.091440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.091897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.092143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.092434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.092757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.093078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.093399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.093987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.094344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.094690 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.095020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.095351 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.096216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.096543 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.096879 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.097191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.097502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.097883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.098342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.098587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.098836 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.099098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.100196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.100196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.100196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.100841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.101073 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.101293 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.101524 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.102252 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.102252 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.102837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.103083 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.103296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.103522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.103761 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.104092 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.104402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.104717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.105038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.105353 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.105661 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.105980 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.106317 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.106656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.106971 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.107281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.107592 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.107907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.109091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.109091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.109091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.109091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.110132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.110132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.110132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.110891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.110891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.112135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.112135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.112790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.112790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.112790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.113510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.113510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.114006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.114006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.114532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.114778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.115053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.115318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.115911 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.116999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.116999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.116999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.117759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.117759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.118259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.118259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.118789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.118789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.119258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.119507 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.119730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.120131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.120379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.120679 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.121016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.121326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.121643 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.121968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.122345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.122630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.122926 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.123290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.123627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.123929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.124269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.124610 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.124925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.125240 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.125548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.125859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.126254 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.126566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.126937 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.127257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.127704 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.128126 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.134441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.135409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.136715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.137034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.137660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.137660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.138106 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.138490 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.138734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.138984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.139231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.139484 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.139730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.140072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.140414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.140741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.141070 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.141390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.141718 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.142042 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.142399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.142801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.143135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.143475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.143917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.144424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.144677 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.144929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.145171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.145458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.145776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.146118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.146484 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.146798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.147133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.147461 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.147795 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.148118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.148442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.148779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.149097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.149416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.149740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.150056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.150403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.150728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.151051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.151388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.151725 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.152050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.152386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.152719 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.153084 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.153404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.153760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.154096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.154470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.154755 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.155069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:54.155319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:03:54.216864 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Registered counter for database nova_api May 26 18:03:54.240877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:54.250362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:54.313646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.context [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b0db0dc-c451-4016-9cfb-3e1d6c7c5950(cell1) {{(pid=117832) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:03:54.319031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.320799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.321718 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.323901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.326079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Registered counter for database nova_cell0 May 26 18:03:54.330904 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Registered counter for database nova_cell1 May 26 18:03:54.340094 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:54.348940 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:54.353627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:54.632465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:54.642343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Registered counter for database nova_cell0 May 26 18:03:54.650589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:54.656047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:54.991905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:03:54.999693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:03:55.370229 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:03:55.376382 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-c20e9cfd-bc9e-4e2f-863d-ae46096cb979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:03:55.382009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a675c0e9c0 pid: 117832 (default app) May 26 18:03:56.173019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:03:56.173598 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:03:56.174400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:03:56.174786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:03:56.175046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:03:56.175654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.175997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.176330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.176673 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.177020 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.177345 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.177679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.178012 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.178384 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.178658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.178986 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.179320 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839064-2-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.179653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.179974 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.180294 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.180628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.180944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.181276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.181593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.182121 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.182473 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.182792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.183117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.183473 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.183796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.184117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.184453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.184771 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.185113 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.185434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.185853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839064-2-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.186221 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.186542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.186873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.187307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.187629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.187952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.188284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.188621 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.188943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.189283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.190726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.191111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.191414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.191727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.192048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.192371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.192706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.193031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.193344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.193605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.193925 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.194285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.194622 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.194966 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.195229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.195489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.195820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.196148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.196477 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.196791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.197110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.197426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.197772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.198054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.198392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.198715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.199039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.199372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.199706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.200023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.200355 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.200834 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.201098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.201415 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.201788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.202100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.202448 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.202780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.203172 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.203430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.203748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.204066 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.204397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.204743 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.205103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.205373 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.205686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.205998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.206384 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.206701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.207016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.207332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.207641 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.207960 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.208270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.208582 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.208896 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.209212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.209525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.209838 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.210153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.210505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.210842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.211169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.211486 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.211799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.212115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.212429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.212758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.213073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.213394 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.213727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.214044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.214388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.214726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.215040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.215356 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.215685 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.215995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.216353 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.216630 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.216944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.217258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.217570 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.217883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.218236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.218530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.218843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.219246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.219453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.219783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.220114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.220438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.221293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.221607 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.221938 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:03:56.222359 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.222702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.223057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.223381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.223728 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.224071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.224398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.224719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.225054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.225392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.225714 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.226045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.226394 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.226722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.227053 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.227397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.227731 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.228054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.228386 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.228705 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.229033 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.229374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.229713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.230038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.230422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.230782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.231106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.231446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.231779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.232103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.232422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.232743 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.233078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.233425 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.233746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.234080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.234428 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.234758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.235079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.235400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.235720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.236076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.236560 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.237384 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.237711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.238039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.238390 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.238715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.239036 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.239352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.239665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.239981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.240304 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.240616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.240948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.241296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.241619 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.241962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.242303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.242629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.242950 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.243271 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.243586 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.243908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.244230 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.244543 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.244884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.245205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.245522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.245854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.246169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.246508 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.246836 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.247155 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.247475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.247796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.248116 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.248451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.248775 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.249093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.249440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.249780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.250097 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.250471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.250806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.251131 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.251449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.251798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.252276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.252599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.252916 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.253238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.253556 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.253874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.254222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.254531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.254851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.255195 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.255514 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.255831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.256147 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.256462 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.256825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.257198 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.257542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.257901 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.258247 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.258588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.258909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.259241 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.259566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.259886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.260209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.260528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.260858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.261180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.261509 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.261843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.262181 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.262531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.262945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.263266 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.263592 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.263948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.264297 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.264633 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.264965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.265289 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.265615 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.265934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.266283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.266608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.266928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.267309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.267632 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.268034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.268361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.268872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.269201 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.269534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.269850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.270181 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.270551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.270902 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.271224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.271550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.271909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.272212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.272530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.272924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.273251 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.273572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.273894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.274250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.274580 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.274904 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.275219 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.275544 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.275864 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.276179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.276493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.276815 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.277153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.277483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.277814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.278149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.278496 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.278814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.279265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.279590 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.279905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.280226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.280894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.281273 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.281583 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.281901 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.282306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.282593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.282913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.283990 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.284743 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.285072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.285417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.285769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.286072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.286487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.286819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.287145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.287468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.287813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.288137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.288461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.288785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.289105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.289425 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.289756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.290402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.290753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.291082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.291534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.291751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.292068 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.292415 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.292821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.293154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.293507 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.293833 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.294154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.294523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.294827 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.295145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.295468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.295790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.296114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.296429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.296744 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.298331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.298331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.298331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.298331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.299928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.300278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.300740 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.301079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.301405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.301729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.302051 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.302454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.302823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.303131 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.303479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.303840 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.304269 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.304547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.304875 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.305188 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.305518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.305833 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.306483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.306807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.307126 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.307451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.307770 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.308100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.308420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.308735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.309056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.309368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.309701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.310019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.310360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.310675 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.311002 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.311320 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.311616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.311938 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.312252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.312581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.312928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.313210 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.313521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.313843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.314160 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.315058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.315058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.315458 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.315458 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.315822 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.316148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.316431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.316718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.317039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.317378 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.317711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.318027 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.318389 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.318693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.319015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.319328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.319650 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.319962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.320353 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.320552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.320873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.321402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.321623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.321825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.322145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.322538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.322912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.323152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.323470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.323844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.324158 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.324483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.324813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.325142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.325463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.325818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.326104 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.326511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.326921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.327245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.327559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.327875 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.328220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.328542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.328853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.329183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.329516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.329848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.330581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.330767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.331111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.331540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.331968 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.332398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.332843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.333291 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.333718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.334144 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.334612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.335042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.335483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.335910 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.336332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.336893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.337409 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.337868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.338599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.339061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.339517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.339967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.340583 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.341067 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.341500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.341922 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.342444 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.342928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.343360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.343805 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.344222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.344784 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.345209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.346325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.346787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.347301 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.347764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.348259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.348786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.349224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.349645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.350081 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.350592 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.351087 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.351531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.352094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.352531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.352959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.353503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.354034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.354503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.354944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.355404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.355849 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.356270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.356702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.357325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.357721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.358243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.358671 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.359103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.359553 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.360023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.360541 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.360984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.362073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.362696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.363233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.363665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.364118 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.364566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.364991 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.365420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.365849 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.366353 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.366787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.367614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.367927 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.368511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.368973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.369413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.369873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.370385 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.370940 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.371436 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.371877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.372314 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.372764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.373211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.373710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.374161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.374661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.375096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.375526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.375973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.376465 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.376952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.377398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.377941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.378535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.379098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.379607 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.380083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.380529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.380973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.381444 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.381873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.382332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.382790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.383213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.383653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.384075 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.384500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.384921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.385345 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.385771 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.386272 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.386677 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.387152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.387581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.388102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.388533 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.388980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.389526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.390057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.390519 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.390929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.391333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.391856 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.392214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.393012 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.393414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.393816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.394239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.394646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.395043 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.395447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.395841 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.396245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.396644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.397112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.397434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.398146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.398615 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.399096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.399529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.400064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.400499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.400930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.401365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.401805 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.402351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.402945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.403419 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.403829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.404241 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.404663 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.405071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.405716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.406122 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.406545 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.406990 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.407393 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.407782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.408783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.409264 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.409700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.410288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.410733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.411178 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.411611 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.412050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.412513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.412982 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.413423 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.413903 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.414408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.414859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.415305 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.415750 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.416184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.416886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.417325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.417777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.418258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.418710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.419267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.419701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.420192 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.420663 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.421051 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.421449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.421838 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.422256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.422753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.423224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.423698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.424695 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.425125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.425834 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.426413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.426863 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.427315 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.427759 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.428193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.428693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.429134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.429659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.430080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.430662 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.431093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.431517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.431945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.432382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.432834 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.433254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.433679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.434102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.434587 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.435010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.435431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.435856 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.436286 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.436705 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.437134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.437556 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.437975 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.438454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.438882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.439309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.439860 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.440312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.440857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.441316 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.441789 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.442280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.442706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.443135 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.443571 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.444029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.444470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.444910 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.445344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.445821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.446347 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.447056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.447506 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.448012 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.448471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.448920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.449344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.449890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.450367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.450823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.451340 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.451854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.452293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.452723 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.453189 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.453620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.454078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.454547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.455392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.455819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.456198 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.456669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.457134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.457608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.458083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.460713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.461024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.461357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.461800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.462037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.462405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.462731 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.463187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.463519 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.463858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.464195 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.464526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.464867 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.465207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.465542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.465882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.466233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.466581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.466941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.467286 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.467629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.467949 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.468267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.468585 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.468909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.469250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.469574 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.469895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.470303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.471120 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.471399 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.471729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.472048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.472366 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.472692 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.473011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.473328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.473645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.473963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.474438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.474605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.474937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.475257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.475577 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.475899 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.476220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.476538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.476895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.477240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.477571 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.477905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.478255 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.478593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.478918 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.479254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.479590 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.479925 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.480257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.480605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.480928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.481254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.481576 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.481899 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.482239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.482560 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.483637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.483637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.483637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.484080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.484229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.484511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.484841 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.485166 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.485513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.485846 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.486252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.487083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.487407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.487728 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.488263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.488597 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.488945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.489282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.489608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.489947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.490319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.490751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.491004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.491368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.491712 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.492039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.492368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.492716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:03:56.492932 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:03:56.555256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Registered counter for database nova_api May 26 18:03:56.576315 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:56.585580 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:56.647622 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.context [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b0db0dc-c451-4016-9cfb-3e1d6c7c5950(cell1) {{(pid=117833) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:03:56.652107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.653781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.654733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.657072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.660010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Registered counter for database nova_cell0 May 26 18:03:56.664590 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Registered counter for database nova_cell1 May 26 18:03:56.673103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:56.677066 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:56.687942 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:56.691851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:57.003015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Registered counter for database nova_cell0 May 26 18:03:57.013718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:03:57.021877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:03:57.406001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:03:57.423404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:03:58.056462 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:03:58.066873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-62d840ed-60e4-4ce5-8fed-8c0b557e90a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:03:58.077415 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55a675c0e9c0 pid: 117833 (default app) May 26 18:04:40.369759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.370782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.371908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.373028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.794124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.795156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.799514 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:40.800494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:42.098010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5b3bcc1d-8fde-4846-b5a6-56e11ef96214 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Action: 'create', calling method: .version_select at 0x7f1fa1b32c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2075747476", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5b3bcc1d-8fde-4846-b5a6-56e11ef96214 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 122 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:42.118913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2075747476", "metadata": {"Type": "work"}}} May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:42.120638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2075747476', 'metadata': {'Type': 'work'}}}} May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '#$%' May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:42.121726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:04:42.124289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:04:42.128626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:04:42.128626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:42.128626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5b3bcc1d-8fde-4846-b5a6-56e11ef96214 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:42.128626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5b3bcc1d-8fde-4846-b5a6-56e11ef96214 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.762225 May 26 18:04:42.128626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 26 18:04:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1764 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:04:42.442930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0118fa38-50b2-49db-8ec5-10f9d73eeee3 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Action: 'create', calling method: .version_select at 0x7f1fa1b31c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-821798469"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:42.612544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93c7fc52-c8a9-45b2-810c-7c5381453a6f tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Action: 'create', calling method: .version_select at 0x7f1fa1a16f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-800315673", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:44.057072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0118fa38-50b2-49db-8ec5-10f9d73eeee3 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.270812 May 26 18:04:44.059020 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 1/2] 10.222.0.76 () {60 vars in 1154 bytes} [Thu May 26 18:04:40 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3274 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 18:04:44.073488 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dd3d2525-835d-4d70-8420-7cc94a4dfc48 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Action: 'create', calling method: .version_select at 0x7f1fa197faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1974052479", "metadata": {"Type": "work"}}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dd3d2525-835d-4d70-8420-7cc94a4dfc48 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 120 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:04:44.092065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1974052479", "metadata": {"Type": "work"}}} May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: May 26 18:04:44.093854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1974052479', 'metadata': {'Type': 'work'}}}} May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise error May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi '0' May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:44.095055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:04:44.096788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:04:44.098006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:04:44.098006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:44.102060 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dd3d2525-835d-4d70-8420-7cc94a4dfc48 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:44.108293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dd3d2525-835d-4d70-8420-7cc94a4dfc48 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045857 May 26 18:04:44.109746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 26 18:04:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:04:44.123662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93c7fc52-c8a9-45b2-810c-7c5381453a6f tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.999288 May 26 18:04:44.124454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 2/4] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 26 18:04:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2001 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 18:04:44.141779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5da701bb-1a67-4ed7-b8df-53200e1f08e6 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa1941160>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.218938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5da701bb-1a67-4ed7-b8df-53200e1f08e6 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 200 len: 344 microversion: 2.1 time: 0.083103 May 26 18:04:44.219519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 3/5] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:44.226754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-991f70c1-7c71-46cd-a0e5-03f97fdbd9c6 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Action: 'create', calling method: .version_select at 0x7f1fa1941820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1679844244", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-991f70c1-7c71-46cd-a0e5-03f97fdbd9c6 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 119 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:44.236975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1679844244", "metadata": {"Type": "work"}}} May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:44.238548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1679844244', 'metadata': {'Type': 'work'}}}} May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '' May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:44.239457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:04:44.240977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:04:44.242314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:04:44.242314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.242460 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2090524154", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "networks": [{"uuid": "13597c6f-f061-4857-86b7-dc277ce72ef7"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:44.242579 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-991f70c1-7c71-46cd-a0e5-03f97fdbd9c6 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:44.242782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-991f70c1-7c71-46cd-a0e5-03f97fdbd9c6 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018508 May 26 18:04:44.243660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 4/6] 10.222.0.76 () {60 vars in 1155 bytes} [Thu May 26 18:04:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:04:44.263383 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-86b249be-3a15-4a9d-ba2c-216149f2dc7a tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa1950670>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.428723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-86b249be-3a15-4a9d-ba2c-216149f2dc7a tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 352 microversion: 2.1 time: 0.177813 May 26 18:04:44.430570 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 5/7] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:44.437329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9082b399-e747-43fe-a0b9-97f9bc4db644 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Calling method '.version_select at 0x7f1fa1941b80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.519336 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] validate_networks() for [('13597c6f-f061-4857-86b7-dc277ce72ef7', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:44.528585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-9082b399-e747-43fe-a0b9-97f9bc4db644 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] HTTP exception thrown: Volume tempest-invalid-295132421 could not be found. May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9082b399-e747-43fe-a0b9-97f9bc4db644 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-295132421 HTTP/1.1 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:44.533887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume tempest-invalid-295132421 could not be found. May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'tempest-invalid-295132421'} May 26 18:04:44.535324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-295132421 could not be found. (HTTP 404) (Request-ID: req-3acb8bf4-0d17-47fe-91c1-04093120577b) May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.536132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:44.537292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-295132421 could not be found. May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:44.538493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-295132421 could not be found. May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-295132421 could not be found. May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9082b399-e747-43fe-a0b9-97f9bc4db644 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 404 to user: Volume tempest-invalid-295132421 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9082b399-e747-43fe-a0b9-97f9bc4db644 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-295132421" status: 404 len: 98 microversion: 2.1 time: 0.103631 May 26 18:04:44.539653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 6/8] 10.222.0.76 () {58 vars in 1214 bytes} [Thu May 26 18:04:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-295132421 => generated 98 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 18:04:44.549715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b9be81e3-5cd7-46b5-92ec-41e84c577ed6 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007628 May 26 18:04:44.550908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 7/9] 10.222.0.76 () {58 vars in 1139 bytes} [Thu May 26 18:04:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:04:44.560343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8120cc0f-69b2-4e10-b851-1dc892f8d0da tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004385 May 26 18:04:44.561478 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 8/10] 10.222.0.76 () {58 vars in 1136 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:04:44.571702 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69c78cbd-4531-482d-81c7-25715eacba6e tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Calling method '.version_select at 0x7f1fa1941af0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.647119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-69c78cbd-4531-482d-81c7-25715eacba6e tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] HTTP exception thrown: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69c78cbd-4531-482d-81c7-25715eacba6e tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/c44f718c-4f71-4204-96d0-d99eacad85ff HTTP/1.1 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:44.649842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'c44f718c-4f71-4204-96d0-d99eacad85ff'} May 26 18:04:44.651552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. (HTTP 404) (Request-ID: req-bfd1b9df-f35c-4a83-b125-fea0d13ee0ef) May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.652343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:44.653481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:04:44.656155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. May 26 18:04:44.660501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.664473 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69c78cbd-4531-482d-81c7-25715eacba6e tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 404 to user: Volume c44f718c-4f71-4204-96d0-d99eacad85ff could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:44.664473 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69c78cbd-4531-482d-81c7-25715eacba6e tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/c44f718c-4f71-4204-96d0-d99eacad85ff" status: 404 len: 109 microversion: 2.1 time: 0.097078 May 26 18:04:44.672022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 9/11] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:04:44 2022] DELETE /compute/v2.1/os-volumes/c44f718c-4f71-4204-96d0-d99eacad85ff => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:04:44.698692 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-890873fc-e518-4d02-b358-962e7d19d372 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Calling method '.version_select at 0x7f1fa191f4c0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.780819 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-890873fc-e518-4d02-b358-962e7d19d372 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] HTTP exception thrown: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-890873fc-e518-4d02-b358-962e7d19d372 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Request method failure captured: May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/3a5149bd-18c9-4a6e-9494-f75efce9cdde HTTP/1.1 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4goNX8h8KiujXYoO_bfthTV3mZyTkpIlJ2H66quey-iVX78cWjLZvFD0GOGXhlsQFQew1k_4LCz51UsKCP1GPer-5r4tgc6mhRSa0YnJUPzZRzvCkXHjJ3CguuUsyBqF7Cc7Qnuw1EpBRT5PdlmzjAay-5vrBPeHdw4Ye-B35Jp0 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:44.784870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_d225e79dd1164e5f92160737fdf84c31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d225e79dd1164e5f92160737fdf84c31 May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-229380353 May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: ccb6bc41828d40d5aca91d1ae51c6a99 May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-229380353-project May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '3a5149bd-18c9-4a6e-9494-f75efce9cdde'} May 26 18:04:44.787756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. (HTTP 404) (Request-ID: req-d2d1f22c-6281-487a-a278-bc2dfc464369) May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.788571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:44.789669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:04:44.790823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. May 26 18:04:44.792162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:44.795853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-890873fc-e518-4d02-b358-962e7d19d372 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] Returning 404 to user: Volume 3a5149bd-18c9-4a6e-9494-f75efce9cdde could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:44.797099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-890873fc-e518-4d02-b358-962e7d19d372 tempest-VolumesNegativeTest-229380353 tempest-VolumesNegativeTest-229380353-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3a5149bd-18c9-4a6e-9494-f75efce9cdde" status: 404 len: 109 microversion: 2.1 time: 0.114166 May 26 18:04:44.797870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 10/12] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/os-volumes/3a5149bd-18c9-4a6e-9494-f75efce9cdde => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:04:45.234165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fabf3cc9-33ea-446d-9fcd-915324699c15 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa1941ca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:45.370508 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fabf3cc9-33ea-446d-9fcd-915324699c15 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 200 len: 345 microversion: 2.1 time: 0.141027 May 26 18:04:45.374241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 11/13] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:45 2022] GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:45.385703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a21810b-6377-4c05-ba00-a6f566ddce6b tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Action: 'create', calling method: .version_select at 0x7f1fa1950670>, body: {"snapshot": {"volume_id": "8693f6ec-7317-4631-9204-80b3e328ddf7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1524939772"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:45.990583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a21810b-6377-4c05-ba00-a6f566ddce6b tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.608814 May 26 18:04:45.991164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 12/14] 10.222.0.76 () {60 vars in 1161 bytes} [Thu May 26 18:04:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:45.996644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3737299a-0432-4df0-94e1-e730af7d78b0 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa1a16b80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.072185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3737299a-0432-4df0-94e1-e730af7d78b0 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 353 microversion: 2.1 time: 0.079810 May 26 18:04:46.073397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 13/15] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:45 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.082144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c26d1df-38b5-402c-93b7-04ea92384e31 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa1941820>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.208119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c26d1df-38b5-402c-93b7-04ea92384e31 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 287 microversion: 2.1 time: 0.132247 May 26 18:04:46.209619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 14/16] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.216324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cce58cfb-f12c-4428-965c-112e100a767a tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa1941d30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.305397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cce58cfb-f12c-4428-965c-112e100a767a tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 353 microversion: 2.1 time: 0.094363 May 26 18:04:46.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 15/17] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.312707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-450e1738-5e51-4117-b6a3-ab0976878d59 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa191f430>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.419368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-450e1738-5e51-4117-b6a3-ab0976878d59 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111307 May 26 18:04:46.426330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 16/18] 10.222.0.76 () {58 vars in 1139 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.430624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e62806e2-d649-4ff1-b027-940e2102125b tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa191f790>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.543732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e62806e2-d649-4ff1-b027-940e2102125b tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 202 len: 0 microversion: 2.1 time: 0.121986 May 26 18:04:46.545197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 17/19] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:04:46 2022] DELETE /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:04:46.560983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-66021151-36d6-4a03-a089-e4937573d9e3 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa191f3a0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.608340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-66021151-36d6-4a03-a089-e4937573d9e3 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 287 microversion: 2.1 time: 0.060688 May 26 18:04:46.609390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 18/20] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.617812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d39c3b76-cf74-424b-a93a-7f871ced83e7 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa19418b0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.736093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d39c3b76-cf74-424b-a93a-7f871ced83e7 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 352 microversion: 2.1 time: 0.124214 May 26 18:04:46.737411 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 19/21] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:46.803957 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:46.805005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:46.805618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:46.806175 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:46.806823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:46.842976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.843935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.846808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.847757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.930482 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Getting quotas for project 6b746bd093c749c5a2ffe6fd3d3e0417. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:46.943161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Getting quotas for user 81b8f193d3354e9784dc62bbae040e72 and project 6b746bd093c749c5a2ffe6fd3d3e0417. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:46.978748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:46.981507 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:47.149661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c3419d2f-1635-46ee-a9e3-825780af5c5c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.037019 May 26 18:04:47.162253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 3/22] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:04:47.170288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7266d333-a762-4f39-8831-c3626b1e0b6a tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.171320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7266d333-a762-4f39-8831-c3626b1e0b6a tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:47.622164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4693274c-b6a6-4675-9c31-3052bad3ff93 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa103fc10>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.622710 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7266d333-a762-4f39-8831-c3626b1e0b6a tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.729137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7266d333-a762-4f39-8831-c3626b1e0b6a tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1215 microversion: 2.1 time: 0.563700 May 26 18:04:47.747602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 20/23] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1215 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:47.757412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9c665b3d-ca5f-4830-84d9-976efbeb2723 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa191f1f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.765463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4693274c-b6a6-4675-9c31-3052bad3ff93 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 287 microversion: 2.1 time: 0.148063 May 26 18:04:47.766117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 4/24] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:47.877621 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9c665b3d-ca5f-4830-84d9-976efbeb2723 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 352 microversion: 2.1 time: 0.126245 May 26 18:04:47.878575 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 21/25] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:48.757352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2c3c811-38fd-43c1-99a7-e492e5e87116 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:48.760891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2c3c811-38fd-43c1-99a7-e492e5e87116 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:48.781412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a4259514-f9ab-40b4-ad46-e2a15fb063dc tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa18dbf70>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:48.827250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a4259514-f9ab-40b4-ad46-e2a15fb063dc tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 287 microversion: 2.1 time: 0.045592 May 26 18:04:48.827861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 22/26] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:48.892118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d709a1c2-2b68-472e-8c80-b370445cba69 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa18dbb80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.002289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d709a1c2-2b68-472e-8c80-b370445cba69 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 200 len: 352 microversion: 2.1 time: 0.115136 May 26 18:04:49.002807 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 23/27] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:49.244870 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2c3c811-38fd-43c1-99a7-e492e5e87116 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.290434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2c3c811-38fd-43c1-99a7-e492e5e87116 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1215 microversion: 2.1 time: 0.536338 May 26 18:04:49.296271 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 5/28] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1215 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:49.840452 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57d276c0-bd2b-4e7d-9dee-86322ac2fd07 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa1941c10>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.913779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57d276c0-bd2b-4e7d-9dee-86322ac2fd07 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 288 microversion: 2.1 time: 0.078173 May 26 18:04:49.914376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 24/29] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:49 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:49.926293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cfc84299-556e-40c0-acd9-eaf61683f97c tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa07f5f70>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.015045 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93badb4c-9953-4fd9-946b-20de02774ba9 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Calling method '.version_select at 0x7f1fa1925670>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.081720 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-93badb4c-9953-4fd9-946b-20de02774ba9 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] HTTP exception thrown: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93badb4c-9953-4fd9-946b-20de02774ba9 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Request method failure captured: May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be HTTP/1.1 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E5zjGK33H-4DMN1WgG62LvmfWOjoZOz3w55pu4RE4YxuN042R25d-jh6p-djwlQbV_Zuy8ULFHQTbqLeXZglQSclHr1vCknOAZqLmW0PJ9g1i8THmYyxaeJwoNkLUqYrKq7yWPZ3-NPk3HP_UpNaDp1hGWCT_k7ONxEib1LAJomj4 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 1ff84f5142c24aa4a50fbcb6510a5624 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesGetTestJSON-2125900417 May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:50.083833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1ff84f5142c24aa4a50fbcb6510a5624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1ff84f5142c24aa4a50fbcb6510a5624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1ff84f5142c24aa4a50fbcb6510a5624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1ff84f5142c24aa4a50fbcb6510a5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesGetTestJSON-2125900417 May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 1ff84f5142c24aa4a50fbcb6510a5624 May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesGetTestJSON-2125900417 May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesGetTestJSON-2125900417-project May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 6d54cc1979ca43b7818bd0d21c1d735f May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesGetTestJSON-2125900417-project May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '0508461b-71ce-4830-9319-e009bee034be'} May 26 18:04:50.084944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. (HTTP 404) (Request-ID: req-29bd29c1-4fec-487e-a12e-8b2aeaed6162) May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:50.085577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:50.086740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:04:50.087897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. May 26 18:04:50.089026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:50.089953 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93badb4c-9953-4fd9-946b-20de02774ba9 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] Returning 404 to user: Volume 0508461b-71ce-4830-9319-e009bee034be could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:50.090938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93badb4c-9953-4fd9-946b-20de02774ba9 tempest-VolumesGetTestJSON-2125900417 tempest-VolumesGetTestJSON-2125900417-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be" status: 404 len: 109 microversion: 2.1 time: 0.079865 May 26 18:04:50.091615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 25/30] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/os-volumes/0508461b-71ce-4830-9319-e009bee034be => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:04:50.150679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cfc84299-556e-40c0-acd9-eaf61683f97c tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 202 len: 0 microversion: 2.1 time: 0.229567 May 26 18:04:50.154560 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 6/31] 10.222.0.76 () {58 vars in 1253 bytes} [Thu May 26 18:04:49 2022] DELETE /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:04:50.162560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0a4ad0f-e096-4c65-9440-b576f4909aa9 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa18dbe50>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.230780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0a4ad0f-e096-4c65-9440-b576f4909aa9 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 200 len: 287 microversion: 2.1 time: 0.072761 May 26 18:04:50.231366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 26/32] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:50.314736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.315389 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:50.326794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.327254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.331473 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.338037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.200769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.229467 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6b36a71a-3387-4702-80dc-e68a73796d84 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1211 microversion: 2.1 time: 0.919668 May 26 18:04:51.245452 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f35784bc-d53c-47d4-8123-ddbe3eb717e2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa19253a0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:51.249509 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 7/33] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1211 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:51.311723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f35784bc-d53c-47d4-8123-ddbe3eb717e2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] HTTP exception thrown: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f35784bc-d53c-47d4-8123-ddbe3eb717e2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Request method failure captured: May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c HTTP/1.1 May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4Hh29uKNxk24myzUX4IlemBJXF3_O8gO4xlLzNxg-UknxxWg4VnoTsbhvIK_MuJqTViLAmwGB4orz2q8AU0OtmnaciyMftKCvuSTVD7mVCGYREVdEApj0I9Cursavus7QKrJR2yG_jEB-KXuEJpKUMf3vpiqZAynNi1kaDivc7tU May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:51.316583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 5389ef3de3094a6ba85f928312c99dde May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '7e191a49-467d-42c2-a81d-b58c23907e1c'} May 26 18:04:51.317723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. (HTTP 404) (Request-ID: req-fcf8e2f0-e5b6-4e2a-92b5-57d1b3edc04a) May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.318408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:51.319265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 18:04:51.320145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f35784bc-d53c-47d4-8123-ddbe3eb717e2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Returning 404 to user: Snapshot 7e191a49-467d-42c2-a81d-b58c23907e1c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:51.321050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f35784bc-d53c-47d4-8123-ddbe3eb717e2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c" status: 404 len: 111 microversion: 2.1 time: 0.080350 May 26 18:04:51.332554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ad833bb8-6d87-4bf3-9672-499f39570bc2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa08069d0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:51.334672 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 27/34] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:04:51 2022] GET /compute/v2.1/os-snapshots/7e191a49-467d-42c2-a81d-b58c23907e1c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:04:51.535935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ad833bb8-6d87-4bf3-9672-499f39570bc2 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 202 len: 0 microversion: 2.1 time: 0.210907 May 26 18:04:51.536504 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 8/35] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:04:51 2022] DELETE /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:04:51.545146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81a7fe92-9417-4b10-90b3-018381086e02 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa18dbee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:51.672448 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81a7fe92-9417-4b10-90b3-018381086e02 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 200 len: 344 microversion: 2.1 time: 0.131089 May 26 18:04:51.673803 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 28/36] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:51 2022] GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:52.268442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.270600 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:52.288549 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.289511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.302453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.303858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.585998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:52.596704 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8188592-7876-4b87-a9b9-3ef8ef0c36f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1273 microversion: 2.1 time: 0.334877 May 26 18:04:52.616107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 9/37] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:52 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:52.685810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-51080158-e56b-4002-aa60-aa4646a72d33 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa1925040>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.747370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-51080158-e56b-4002-aa60-aa4646a72d33 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] HTTP exception thrown: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-51080158-e56b-4002-aa60-aa4646a72d33 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Request method failure captured: May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 HTTP/1.1 May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4Hh29uKNxk24myzUX4IlemBJXF3_O8gO4xlLzNxg-UknxxWg4VnoTsbhvIK_MuJqTViLAmwGB4orz2q8AU0OtmnaciyMftKCvuSTVD7mVCGYREVdEApj0I9Cursavus7QKrJR2yG_jEB-KXuEJpKUMf3vpiqZAynNi1kaDivc7tU May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:52.749312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 5389ef3de3094a6ba85f928312c99dde May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '8693f6ec-7317-4631-9204-80b3e328ddf7'} May 26 18:04:52.750358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. (HTTP 404) (Request-ID: req-c4cedced-135e-4917-80fb-c6de3276bd36) May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.751036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:52.752649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:04:52.753671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-51080158-e56b-4002-aa60-aa4646a72d33 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Returning 404 to user: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-51080158-e56b-4002-aa60-aa4646a72d33 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 404 len: 109 microversion: 2.1 time: 0.068997 May 26 18:04:52.754684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 29/38] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:52 2022] GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:04:52.769562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6db613f-e28c-41df-b4df-39a04fc4dbff tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa078f940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.824755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-e6db613f-e28c-41df-b4df-39a04fc4dbff tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] HTTP exception thrown: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6db613f-e28c-41df-b4df-39a04fc4dbff tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Request method failure captured: May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 HTTP/1.1 May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8E4Hh29uKNxk24myzUX4IlemBJXF3_O8gO4xlLzNxg-UknxxWg4VnoTsbhvIK_MuJqTViLAmwGB4orz2q8AU0OtmnaciyMftKCvuSTVD7mVCGYREVdEApj0I9Cursavus7QKrJR2yG_jEB-KXuEJpKUMf3vpiqZAynNi1kaDivc7tU May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:04:52.843114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 5389ef3de3094a6ba85f928312c99dde May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '8693f6ec-7317-4631-9204-80b3e328ddf7'} May 26 18:04:52.844285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. (HTTP 404) (Request-ID: req-7969c159-ab76-4274-bee6-aa48b81142b2) May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.845494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:04:52.847071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:04:52.847980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6db613f-e28c-41df-b4df-39a04fc4dbff tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Returning 404 to user: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:52.849756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6db613f-e28c-41df-b4df-39a04fc4dbff tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 404 len: 109 microversion: 2.1 time: 0.080219 May 26 18:04:52.853997 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9becd390-4008-4ee8-a0eb-f972720641d5 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Calling method '.version_select at 0x7f1fa187b310>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.861636 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 10/39] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:04:52 2022] DELETE /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:04:52.938163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-9becd390-4008-4ee8-a0eb-f972720641d5 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] HTTP exception thrown: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9becd390-4008-4ee8-a0eb-f972720641d5 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Request method failure captured: May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 HTTP/1.1 May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E4Hh29uKNxk24myzUX4IlemBJXF3_O8gO4xlLzNxg-UknxxWg4VnoTsbhvIK_MuJqTViLAmwGB4orz2q8AU0OtmnaciyMftKCvuSTVD7mVCGYREVdEApj0I9Cursavus7QKrJR2yG_jEB-KXuEJpKUMf3vpiqZAynNi1kaDivc7tU May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:04:52.942067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9c09ef491df74d48b81e8346d6ee228a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 9c09ef491df74d48b81e8346d6ee228a May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-339671349 May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 5389ef3de3094a6ba85f928312c99dde May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-339671349-project May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '8693f6ec-7317-4631-9204-80b3e328ddf7'} May 26 18:04:52.943172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. (HTTP 404) (Request-ID: req-0db2af5e-37db-4fac-8d40-883eecdb6d7a) May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.944311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:04:52.945488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:04:52.946941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. May 26 18:04:52.948190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:04:52.951741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9becd390-4008-4ee8-a0eb-f972720641d5 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] Returning 404 to user: Volume 8693f6ec-7317-4631-9204-80b3e328ddf7 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:04:52.952893 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9becd390-4008-4ee8-a0eb-f972720641d5 tempest-VolumesSnapshotsTestJSON-339671349 tempest-VolumesSnapshotsTestJSON-339671349-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7" status: 404 len: 109 microversion: 2.1 time: 0.102787 May 26 18:04:52.955158 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 30/40] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:04:52 2022] GET /compute/v2.1/os-volumes/8693f6ec-7317-4631-9204-80b3e328ddf7 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:04:53.623402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:53.628688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:53.660243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.661329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.666004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.666004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.039141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.057276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a38ead06-616c-4126-86b5-4366ca709a78 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1273 microversion: 2.1 time: 0.431005 May 26 18:04:54.069894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 11/41] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:53 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:55.076790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:55.077639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:55.097306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.097770 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.098660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.099130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.911643 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:55.979861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b0d4fe33-ac79-47e7-9b97-1a9d199ce233 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1273 microversion: 2.1 time: 0.906097 May 26 18:04:55.982139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 31/42] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:55 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1273 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:56.689105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6e42ce8-1775-43e3-b596-e91f742ba6e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: .version_select at 0x7f1fa0753dc0>, body: {"keypair": {"name": "tempest-keypair-1927179739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7vD+8mIpapLEfkVPG2zX3vxIpwy5PGkqFWPfPS/AER3Qkm1mLKIn7tgeVsIqauX5k6A/ueUPEfCr9W2qqt3R3Z2fJ31/8Q3LvmkAyMU5HLZHH8UKNRvjvybdwTZAlobw=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:56.778742 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b6e42ce8-1775-43e3-b596-e91f742ba6e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for project c0b976166b884524b9a3855712be72de. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:56.790245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b6e42ce8-1775-43e3-b596-e91f742ba6e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for user f6b5113ea0f4484ba91a5f0e6184ca35 and project c0b976166b884524b9a3855712be72de. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:56.884806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:56.917156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6e42ce8-1775-43e3-b596-e91f742ba6e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.758934 May 26 18:04:56.928388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 12/43] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:04:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:57.002667 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:57.004127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:57.029558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.036678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.037857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.039372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.716788 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:59.903402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.921331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7f64099f-a43a-4eac-b525-d22803bc53b6 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 2.925333 May 26 18:04:59.926650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 32/44] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:04:56 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 2931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:00.943522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.945354 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.957528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.966619 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.967906 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.970996 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.400908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0f37239-2349-4f39-a1ab-2c8cd74aa276 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: .version_select at 0x7f1fa1817ca0>, body: {"keypair": {"name": "tempest-keypair-1645322864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cRGWFrznVqhfsmQGyBlQwO7ZpjbR6ttq4PzhJTdzanneSJFK+gopvXeP2VDPKExHniupwE+nSVIqUsaibYl4m5CY4Q16VsdBYrvuNCh1JHULR1CWESMw+v5zhl+rhlA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:03.632411 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-d0f37239-2349-4f39-a1ab-2c8cd74aa276 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:03.639806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.660792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7cd029b2-3acf-4bb7-8733-cd4568b0ed25 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 2.722309 May 26 18:05:03.664520 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 13/45] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:00 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 2727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:03.676212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-d0f37239-2349-4f39-a1ab-2c8cd74aa276 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:03.908366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d0f37239-2349-4f39-a1ab-2c8cd74aa276 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.341696 May 26 18:05:03.922034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 33/46] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:05:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:04.151696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-659815454", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:04.319910 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] validate_networks() for [('674e4916-1510-4fc4-b57b-b0089244acfe', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:05:04.775951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-604a2eb9-8558-4c0e-827f-c9dc70c781a6 req-7619bcae-c64b-4d4e-99f4-b95c746852b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1664374d-3fde-4a0f-b37c-4eed1d6e487e", "tag": "a005425b-e20a-47bb-9ff2-fd8bbe43e0c3"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:04.846815 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-604a2eb9-8558-4c0e-827f-c9dc70c781a6 req-7619bcae-c64b-4d4e-99f4-b95c746852b0 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.847597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-604a2eb9-8558-4c0e-827f-c9dc70c781a6 req-7619bcae-c64b-4d4e-99f4-b95c746852b0 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.983513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-604a2eb9-8558-4c0e-827f-c9dc70c781a6 req-7619bcae-c64b-4d4e-99f4-b95c746852b0 service nova] Creating event network-changed:a005425b-e20a-47bb-9ff2-fd8bbe43e0c3 for instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e on hv-cinder-83906 May 26 18:05:04.986283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-604a2eb9-8558-4c0e-827f-c9dc70c781a6 req-7619bcae-c64b-4d4e-99f4-b95c746852b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:05:04.993278 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.001724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.005126 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.009431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.074995 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.compute.rpcapi [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:05:05.096453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] Releasing lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:05:05.197701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ad32e77-c689-4191-bd4e-f9d5bf2e6aaf None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.806946 May 26 18:05:05.199250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 34/47] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:05.219938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:05.223955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:05.247634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.255117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.256889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.263547 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.761859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.773040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5a14b79d-5e71-4521-90bf-0550c0978a0b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.572184 May 26 18:05:05.773807 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 35/48] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:05 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:06.791947 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:06.792697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:06.801701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.815592 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.816754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.817236 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.829634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=12 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:07.236681 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.252800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6049f476-b6cd-498d-98bd-edb08a4c41f9 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.464758 May 26 18:05:07.254505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 36/49] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:06 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:08.288604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:08.289458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:08.322358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.327885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.329563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.332381 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:09.069963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:09.080007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6b3f414-d0e8-410c-9180-3eedb13462f3 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.796794 May 26 18:05:09.086255 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 37/50] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:08 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:09.654506 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:05:09.656137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:05:09.657999 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:05:09.659311 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:05:09.660433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:05:09.691677 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:09.694142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:09.698371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:09.698861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:09.751882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:09.758505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for user 61f6dbd4328e459eb7d4f029551648bb and project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:09.788354 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:05:09.794546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:05:09.888816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b69300b5-244f-41fb-a99c-9b2eee50393c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.007579 May 26 18:05:09.890309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 14/51] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:05:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 6010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:05:09.915127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-71e885ad-f4ef-4d73-a77d-022c0eb4d741 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:09.915776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-71e885ad-f4ef-4d73-a77d-022c0eb4d741 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:10.113000 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:10.115329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:10.123832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:10.126784 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.128063 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:10.129186 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.565764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71e885ad-f4ef-4d73-a77d-022c0eb4d741 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:10.582334 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-71e885ad-f4ef-4d73-a77d-022c0eb4d741 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1221 microversion: 2.1 time: 0.674855 May 26 18:05:10.614121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 38/52] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:09 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1221 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:10.856116 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126329092", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:10.965578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:11.067113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] validate_networks() for [('674e4916-1510-4fc4-b57b-b0089244acfe', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:05:11.103654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:11.120875 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=33 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:11.139312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f24354c9-646a-4e1d-b2a8-3ccde72f8bd0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 1.033235 May 26 18:05:11.147396 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 15/53] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:10 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:11.799688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1665698390", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31cac232-9768-4083-9065-c20228929068"}], "security_groups": [{"name": "tempest-securitygroup--2096610764"}], "key_name": "tempest-keypair-1927179739", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:11.848466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:12.532897 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] validate_networks() for [('31cac232-9768-4083-9065-c20228929068', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:05:14.408151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:05:14.410034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:05:14.411085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:05:14.412278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:05:14.413255 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:05:14.460397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.461314 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.462829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.463588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.573081 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for project c0b976166b884524b9a3855712be72de. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:14.582566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for user f6b5113ea0f4484ba91a5f0e6184ca35 and project c0b976166b884524b9a3855712be72de. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:14.635096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:05:14.642665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:05:14.804193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f59ca129-6212-4f22-acfa-2951127c769b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.011674 May 26 18:05:14.811923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 16/54] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:05:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:05:14.825326 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:14.826781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:14.840041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.841187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.843242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.845463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.890121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:05:14.891608 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:05:14.893781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:05:14.896049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:05:14.896705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:05:14.954427 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.955027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.955947 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.961101 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.053050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:15.073593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for user 61f6dbd4328e459eb7d4f029551648bb and project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:15.142697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:05:15.157112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:05:15.348491 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c542206b-ff54-4b6c-b7e6-9ba04c2e02bf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.494551 May 26 18:05:15.357598 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 39/55] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:05:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:05:15.378584 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41520d6f-4cc8-4e6c-a96f-091f46255cd9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:15.379844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41520d6f-4cc8-4e6c-a96f-091f46255cd9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:15.553016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:15.596933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41520d6f-4cc8-4e6c-a96f-091f46255cd9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:15.607071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77071359-beb4-4f7c-8583-ae31cb50accb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.789693 May 26 18:05:15.613963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 17/56] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:14 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:15.625165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41520d6f-4cc8-4e6c-a96f-091f46255cd9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1238 microversion: 2.1 time: 0.262846 May 26 18:05:15.647517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 40/57] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:15 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1238 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:15.658068 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-975151ee-1a0e-4119-b54c-a777307d024c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:15.661358 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-975151ee-1a0e-4119-b54c-a777307d024c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:15.848565 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-975151ee-1a0e-4119-b54c-a777307d024c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:15.860303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-975151ee-1a0e-4119-b54c-a777307d024c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1221 microversion: 2.1 time: 0.240793 May 26 18:05:15.861879 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 18/58] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:15 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:15.987504 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-363043716", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88540240-a343-4b80-bbe6-aa98a82d692f"}], "security_groups": [{"name": "tempest-securitygroup--1709501312"}], "key_name": "tempest-keypair-1645322864", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:16.365139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] validate_networks() for [('88540240-a343-4b80-bbe6-aa98a82d692f', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:05:16.646470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:16.647156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:16.668022 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.674754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.678886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.683665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.220957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:05:17.221518 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:05:17.222096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:05:17.222654 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:05:17.223163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:05:17.245013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.249313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.252243 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.258096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.317286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:17.324407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:17.357004 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:05:17.359356 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:05:17.471867 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-49de1d86-6800-4ad6-8f81-3a45556a4da9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.489771 May 26 18:05:17.472528 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 41/59] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:05:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:05:17.477268 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:17.483168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:17.495108 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.495919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.497885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.531110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.628170 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.664891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1614b366-9a15-499a-97db-c26ee05c3db7 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1296 microversion: 2.1 time: 0.190838 May 26 18:05:17.667898 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 42/60] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:17 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1296 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:17.674169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:17.675440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:17.708961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.709710 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.713960 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.714699 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.743986 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.765414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5919aed8-67c7-4884-ae88-7ea06307c939 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 1.123024 May 26 18:05:17.769595 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 19/61] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:16 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:17.800038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2962704d-370d-4416-ac79-208cf9de71f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:17.801191 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2962704d-370d-4416-ac79-208cf9de71f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:17.945796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.964329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3f6b056-f980-4154-b61e-1be8cf6927b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1273 microversion: 2.1 time: 0.292560 May 26 18:05:17.964978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 43/62] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:17 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:18.002995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2962704d-370d-4416-ac79-208cf9de71f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.014040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2962704d-370d-4416-ac79-208cf9de71f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1241 microversion: 2.1 time: 0.242096 May 26 18:05:18.018330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 20/63] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:17 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:18.683785 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:18.685178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:18.702830 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.707658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.708948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.710152 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.856180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.873673 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9870e7c-a728-4ea3-ae38-7fb061f19b31 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1296 microversion: 2.1 time: 0.193793 May 26 18:05:18.875758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 44/64] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:18 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1296 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:18.883511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:18.884409 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:18.913390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.913849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.914745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.916774 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.934169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7e13614d-1066-4ba6-93cf-4e38e2de5c7e req-32aa8412-26dd-4b72-a586-eea08cd9fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664374d-3fde-4a0f-b37c-4eed1d6e487e", "name": "network-vif-plugged", "status": "completed", "tag": "a005425b-e20a-47bb-9ff2-fd8bbe43e0c3"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:18.972992 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7e13614d-1066-4ba6-93cf-4e38e2de5c7e req-32aa8412-26dd-4b72-a586-eea08cd9fcd6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.973451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7e13614d-1066-4ba6-93cf-4e38e2de5c7e req-32aa8412-26dd-4b72-a586-eea08cd9fcd6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.019945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7e13614d-1066-4ba6-93cf-4e38e2de5c7e req-32aa8412-26dd-4b72-a586-eea08cd9fcd6 service nova] Creating event network-vif-plugged:a005425b-e20a-47bb-9ff2-fd8bbe43e0c3 for instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e on hv-cinder-83906 May 26 18:05:19.022554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7e13614d-1066-4ba6-93cf-4e38e2de5c7e req-32aa8412-26dd-4b72-a586-eea08cd9fcd6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:05:19.023937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.024821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.031075 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.033072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.059139 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.compute.rpcapi [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:05:19.060287 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] Releasing lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:05:19.105345 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00565c55-07ca-4161-afcb-d9a4a0d82f4a None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393752 May 26 18:05:19.106225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 21/65] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:19.112811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:19.114453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:19.130746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.135483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.141190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.142797 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.444195 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.455766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1704e928-d671-4135-80a2-2513507e7cba tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.578836 May 26 18:05:19.462981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 45/66] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:18 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:19.479384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:19.480756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:19.504338 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.505705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.508908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.510659 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.514412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.531082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ccee2ba1-8c79-4cfe-9645-86dee169e348 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1279 microversion: 2.1 time: 0.420312 May 26 18:05:19.535440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 22/67] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:19 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:19.582876 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3bb84c4e-d1d1-4884-a4c7-dadbef3993b8 req-c5d11b30-0f90-4793-839e-60d0e0d7324a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e2e233-cbae-48e1-aa0e-cfc0231e18b3", "tag": "c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:19.614262 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3bb84c4e-d1d1-4884-a4c7-dadbef3993b8 req-c5d11b30-0f90-4793-839e-60d0e0d7324a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.617781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3bb84c4e-d1d1-4884-a4c7-dadbef3993b8 req-c5d11b30-0f90-4793-839e-60d0e0d7324a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.661228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3bb84c4e-d1d1-4884-a4c7-dadbef3993b8 req-c5d11b30-0f90-4793-839e-60d0e0d7324a service nova] Creating event network-changed:c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb for instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 on hv-cinder-83906 May 26 18:05:19.678924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3bb84c4e-d1d1-4884-a4c7-dadbef3993b8 req-c5d11b30-0f90-4793-839e-60d0e0d7324a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098687 May 26 18:05:19.687183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 23/68] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:19.748039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.764556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d3b8663-4456-40ea-b91a-f3154d5efc09 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1301 microversion: 2.1 time: 0.299884 May 26 18:05:19.766397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 46/69] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:19 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1301 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:19.892653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:19.893567 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:19.904820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.905777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.907584 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.908221 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:20.479970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:20.480733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:20.494946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:20.497087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:20.498983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:20.501916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.106552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.121151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b1b5d1af-08b9-4082-9077-d94a8df454d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 1.233379 May 26 18:05:21.135722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 24/70] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:19 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:21.144130 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:21.144764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:21.158263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.158971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.159924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.160547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.279476 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.287068 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=73 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:21.311367 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4efb3784-8cb7-4222-a8c9-daaec180309f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.836236 May 26 18:05:21.319705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 47/71] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:20 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:21.331290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:21.335418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:21.351790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.351938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.352643 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.353963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.471606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.493787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8360ddfe-183a-4319-8fd2-fdb34a04e02b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1299 microversion: 2.1 time: 0.168184 May 26 18:05:21.495258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 48/72] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:21 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:22.144063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:22.144845 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:22.159502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.163216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.168451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.169275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.357105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:22.366295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e4b92b9e-306a-4131-88c6-b62196c435e5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.228903 May 26 18:05:22.366986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 49/73] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:22 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:22.435242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-98c8b28f-68f6-4efa-807a-3d828cc3a650 req-ea842b3d-4e43-496c-a60f-b44bfcc539dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6004051-2831-4f2d-a998-0e4c56354f34", "tag": "25a14006-975e-4a8e-9d3d-96f25c4467f0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:22.443666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-98c8b28f-68f6-4efa-807a-3d828cc3a650 req-ea842b3d-4e43-496c-a60f-b44bfcc539dd service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.444117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-98c8b28f-68f6-4efa-807a-3d828cc3a650 req-ea842b3d-4e43-496c-a60f-b44bfcc539dd service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.457190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-98c8b28f-68f6-4efa-807a-3d828cc3a650 req-ea842b3d-4e43-496c-a60f-b44bfcc539dd service nova] Creating event network-changed:25a14006-975e-4a8e-9d3d-96f25c4467f0 for instance e6004051-2831-4f2d-a998-0e4c56354f34 on hv-cinder-83906 May 26 18:05:22.464706 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-98c8b28f-68f6-4efa-807a-3d828cc3a650 req-ea842b3d-4e43-496c-a60f-b44bfcc539dd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096161 May 26 18:05:22.465412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 50/74] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:22.473186 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:22.474100 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:22.481166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.481635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.482452 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.482933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.523593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:22.533136 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a22275fe-2d73-4768-a368-4b136be57ef6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 1.396221 May 26 18:05:22.534054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 25/75] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:21 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:22.539876 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:22.540795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:22.550271 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.551572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.553282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.554429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.689641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:22.698036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-002de41e-d61e-4cd5-bda6-428aaadac5fb tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.231130 May 26 18:05:22.698894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 51/76] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:22 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:22.719184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:22.728943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa0ab93a-260e-41cb-9325-3ca9ee5e60b2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1299 microversion: 2.1 time: 0.193473 May 26 18:05:22.729569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 26/77] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:22 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:23.391771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:23.393085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:23.407599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.408234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.409272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.410099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.555623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:23.556879 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:23.570748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.572997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.573960 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.586929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.726917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:23.736862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6b6d3d5e-728b-4198-a608-92edf4c798e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.351864 May 26 18:05:23.751690 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 52/78] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:23 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:23.756909 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:23.764204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:23.776696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.781235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.785025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.785482 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.004102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.018644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47d1cafd-9b33-4224-b6c7-ab4e8a083258 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.468324 May 26 18:05:24.019821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 27/79] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:23 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:24.025814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:24.027753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:24.040994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.043841 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.047528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.048140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.059536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.070675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c19cf049-5160-4a3f-86fc-f1a419babc51 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.317021 May 26 18:05:24.076310 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 53/80] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:23 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:24.087092 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cc2dc8ee-755e-46cd-a824-d927c7ec4a29 req-2e69a6a3-2a5e-49d1-b457-2e20453828d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8623e13-810b-433d-9e9d-e588bb5781eb", "tag": "52f8b000-2834-4a6a-86b1-591ea06d67c9"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:24.102573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cc2dc8ee-755e-46cd-a824-d927c7ec4a29 req-2e69a6a3-2a5e-49d1-b457-2e20453828d6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.103187 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cc2dc8ee-755e-46cd-a824-d927c7ec4a29 req-2e69a6a3-2a5e-49d1-b457-2e20453828d6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.119638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cc2dc8ee-755e-46cd-a824-d927c7ec4a29 req-2e69a6a3-2a5e-49d1-b457-2e20453828d6 service nova] Creating event network-changed:52f8b000-2834-4a6a-86b1-591ea06d67c9 for instance c8623e13-810b-433d-9e9d-e588bb5781eb on hv-cinder-83906 May 26 18:05:24.129444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cc2dc8ee-755e-46cd-a824-d927c7ec4a29 req-2e69a6a3-2a5e-49d1-b457-2e20453828d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045983 May 26 18:05:24.130650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 54/81] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:24.297461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.306307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f5949a4e-f176-4fdc-a4c0-ca7cee9f489d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.285122 May 26 18:05:24.307512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 28/82] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:24 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:24.757533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:24.758386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:24.773611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.774102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.774928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.775503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.952571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.961841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa115e8c-fb1e-4027-96b8-5f6ed04aa95a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.208452 May 26 18:05:24.963998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 55/83] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:24 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:25.037330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:25.038055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:25.045200 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.045582 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.046470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.046959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.092208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:25.099876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:25.111739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.111739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.111739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.111739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.286344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.297340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-372c7c65-5b14-48b9-a1dc-2d729b11f0f5 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.212130 May 26 18:05:25.302433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.304204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 56/84] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:25 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:25.319542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d4bfecf-869b-4a29-99cb-43fb8bd6ebda tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.286041 May 26 18:05:25.329898 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 29/85] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:25 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:25.335466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:25.336086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:25.343648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.345582 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.346611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.347047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.536468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.546472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad7c6d10-9479-472c-963c-3918c05b1e11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.225697 May 26 18:05:25.549029 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 57/86] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:25 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:25.989109 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:25.989884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:26.001731 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.002974 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.006155 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.006723 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.322606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:26.327118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:26.337462 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.338026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.338985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.339623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.799513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:26.812587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0927f4c2-1fbd-4b97-8ce5-24918806146c tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1315 microversion: 2.1 time: 0.495187 May 26 18:05:26.823181 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 58/87] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:26 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:26.834521 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:26.835316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:26.844140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.844773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.845705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.846372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.005912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.019722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d09cb915-a716-4381-9a86-52579f254315 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 1.035340 May 26 18:05:27.021345 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 30/88] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:25 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:27.054940 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:27.056207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:27.061316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.096383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.096599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4140f739-967b-4ed9-9cc1-277796367622 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.260026 May 26 18:05:27.097102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 59/89] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:26 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:27.097375 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.098854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.099459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.573595 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.590947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af6e3a56-9e34-4a66-8854-01388c2bb27f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.567358 May 26 18:05:27.593459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 31/90] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:27 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:27.832198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:27.833260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:27.835636 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:27.836300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=20 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:27.857329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.858044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.858881 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.860059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.048174 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:28.059625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:28.076813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=16 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:28.082352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.083180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.101923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.103706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.188697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:28.206724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d6633c3-5a1b-440f-8dd9-4a7ec9ace7db tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1501 microversion: 2.1 time: 0.379371 May 26 18:05:28.207340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 60/91] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:27 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:28.232525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-09b2913c-7bb1-43f0-bbe9-5706c37a528a req-81d2677c-5d81-4b31-91e6-31e51d46746b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9288cf08-2b09-4c42-9831-8fbaa8f789ca", "tag": "c6d58bd6-9928-4743-8a53-a4e8c97f7f99"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:28.251028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-09b2913c-7bb1-43f0-bbe9-5706c37a528a req-81d2677c-5d81-4b31-91e6-31e51d46746b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.268268 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-09b2913c-7bb1-43f0-bbe9-5706c37a528a req-81d2677c-5d81-4b31-91e6-31e51d46746b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.305752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-09b2913c-7bb1-43f0-bbe9-5706c37a528a req-81d2677c-5d81-4b31-91e6-31e51d46746b service nova] Creating event network-changed:c6d58bd6-9928-4743-8a53-a4e8c97f7f99 for instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca on hv-cinder-83906 May 26 18:05:28.315486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-09b2913c-7bb1-43f0-bbe9-5706c37a528a req-81d2677c-5d81-4b31-91e6-31e51d46746b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104127 May 26 18:05:28.316905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 61/92] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:28.325533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:28.326686 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:28.349919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.350519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.351363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.351803 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.608424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:28.616860 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-43c3161b-3b53-499f-9a13-c69c668d2e0b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.580877 May 26 18:05:28.618781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 32/93] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:28 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:28.624780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-b73f72b0-25f9-457a-9754-ea517de37663 req-5de2a2d9-6a7f-4321-948f-a431611f2288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e2e233-cbae-48e1-aa0e-cfc0231e18b3", "name": "network-vif-plugged", "status": "completed", "tag": "c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:28.632900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:28.636301 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b73f72b0-25f9-457a-9754-ea517de37663 req-5de2a2d9-6a7f-4321-948f-a431611f2288 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.637578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b73f72b0-25f9-457a-9754-ea517de37663 req-5de2a2d9-6a7f-4321-948f-a431611f2288 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.645614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8c1394a-b075-42e1-bfd2-1c1f004b1f03 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.326533 May 26 18:05:28.654411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-b73f72b0-25f9-457a-9754-ea517de37663 req-5de2a2d9-6a7f-4321-948f-a431611f2288 service nova] Creating event network-vif-plugged:c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb for instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 on hv-cinder-83906 May 26 18:05:28.656837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 62/94] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:28 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:28.662015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-b73f72b0-25f9-457a-9754-ea517de37663 req-5de2a2d9-6a7f-4321-948f-a431611f2288 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041732 May 26 18:05:28.662703 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 33/95] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:28.667426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:28.669081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:28.676776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.677413 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.678324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.678885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.861354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:28.884113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7eb2c8cb-75f7-4f67-a6f2-4677aa1729d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.223976 May 26 18:05:28.884833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 63/96] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:28 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:29.634286 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:29.638936 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:29.639777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:29.647510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.648164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.649163 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.649789 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.666495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:29.667812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:29.677841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.678822 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.679928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.680623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.832071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:29.840762 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4c01c11a-5d32-41f6-be32-262c1389d08e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.207547 May 26 18:05:29.852242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 34/97] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:29 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:29.903227 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:29.903862 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:29.905532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:29.911579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.912281 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.913090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.913605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.918315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b5e3fa2-8fcf-4ebd-b4ee-149a0e892969 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.258268 May 26 18:05:29.919091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 64/98] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:29 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:30.156139 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:30.173188 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ce1c3b8-ce8d-4dfd-abb3-603231a5b2d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.273833 May 26 18:05:30.187132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 35/99] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:29 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:30.208542 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "847fc9f2-42aa-42ed-b664-4a6d0ef26002"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:30.209715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:30.218242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.218242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:30.219245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.219784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:30.862263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:30.863010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:30.869529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.870083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:30.870990 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.874669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.058663 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.061868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:31.082487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe1953a7-c595-4227-8adc-86f4f5d9f9fa tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.224842 May 26 18:05:31.084246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 36/100] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:30 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:31.101298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:31.102489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.113023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.113479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.114309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.114751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.241603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:31.358455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.383789 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-93212d35-f20d-464b-b038-2b5aa47f2e00 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.296860 May 26 18:05:31.408292 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 37/101] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:31 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:31.416257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:31.417530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.427256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.428147 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.429496 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.430896 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.508498 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8f3c3a8a-ae05-46a1-8e91-1f243bec325f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "POST /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.303249 May 26 18:05:31.511441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 65/102] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:05:30 2022] POST /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:31.733332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.747843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5ac6c88b-d9e5-4797-bed5-b5add1f89d20 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.337247 May 26 18:05:31.749284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 38/103] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:31 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:32.104593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:32.107713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:32.119965 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.120481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.121555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.122388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.415121 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:32.416752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:32.432061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.437667 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.442177 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.443040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.449393 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:32.471288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-694fb0b3-1f83-4a41-b6dd-91a2ea895661 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.372956 May 26 18:05:32.475414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 66/104] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:32 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:32.654778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cbc47821-2074-490c-9e84-ad5968bdfb9d req-6432074f-6802-48ab-b4d9-f2b738296246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8623e13-810b-433d-9e9d-e588bb5781eb", "name": "network-vif-plugged", "status": "completed", "tag": "52f8b000-2834-4a6a-86b1-591ea06d67c9"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:32.667522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cbc47821-2074-490c-9e84-ad5968bdfb9d req-6432074f-6802-48ab-b4d9-f2b738296246 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.668737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cbc47821-2074-490c-9e84-ad5968bdfb9d req-6432074f-6802-48ab-b4d9-f2b738296246 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.683047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cbc47821-2074-490c-9e84-ad5968bdfb9d req-6432074f-6802-48ab-b4d9-f2b738296246 service nova] Creating event network-vif-plugged:52f8b000-2834-4a6a-86b1-591ea06d67c9 for instance c8623e13-810b-433d-9e9d-e588bb5781eb on hv-cinder-83906 May 26 18:05:32.691165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cbc47821-2074-490c-9e84-ad5968bdfb9d req-6432074f-6802-48ab-b4d9-f2b738296246 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041038 May 26 18:05:32.691800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 67/105] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:32.709558 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:32.721506 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-53f65024-58ae-4fc5-bf3f-026f328bb8bb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.312483 May 26 18:05:32.722099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 39/106] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:32 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:32.776296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:32.776983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:32.786852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.787320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.788186 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.788660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.998617 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.010134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-66e2be07-f491-4e51-bd64-dfd8586785cd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.238924 May 26 18:05:33.021248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 68/107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:32 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:33.502034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:33.507208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:33.529901 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.531343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.535004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.536128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.740007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:33.741253 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:33.745599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.756102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c1de7ce-478a-4e4f-9800-d12297fb9c2f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.265300 May 26 18:05:33.762342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.763336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.765210 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.766911 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 40/108] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:33 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:33.769434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.036551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:34.039080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:34.060778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.061746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.063124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.064963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.221792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.230779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e4390bc-998e-4a43-9d90-e074386aa60b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.495127 May 26 18:05:34.231371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 69/109] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:33 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:34.380062 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.388608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1620f1ad-568c-421d-a99c-af2bdd990747 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.362185 May 26 18:05:34.389597 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 41/110] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:34 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:34.775966 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:34.776893 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:34.784722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.785175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.786001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.786475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.045576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:35.075272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6b35b1b8-606c-4cd4-a682-75b90f595024 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1364 microversion: 2.1 time: 0.303842 May 26 18:05:35.080188 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 70/111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:34 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:35.258792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:35.259421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:35.274006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.274488 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.275279 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.275717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.409179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:35.409798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:35.420099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.420947 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.422147 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.422701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.651718 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:35.661131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d9529e7f-1f4a-4f5a-a44e-3b5c01c4eff1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.257012 May 26 18:05:35.661772 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 71/112] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:35 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:35.730443 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:35.739199 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c03735e2-396f-4889-a1e7-4f1a699a622a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.490805 May 26 18:05:35.739930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 42/113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:35 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:36.111053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:36.112224 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:36.138118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.138977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.140124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.141546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.311376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:36.321577 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8bfb33b3-60cf-4bf0-a947-44ed05ae8642 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1550 microversion: 2.1 time: 0.222812 May 26 18:05:36.322553 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 72/114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:36 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1550 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:36.340562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:36.349976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:36.361646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.362617 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.364251 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.365125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.511340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-0bef9f0a-a902-492e-9da1-7bc9fd6789fa req-12dceb12-3239-4a84-92fd-70ced28259a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9288cf08-2b09-4c42-9831-8fbaa8f789ca", "name": "network-vif-plugged", "status": "completed", "tag": "c6d58bd6-9928-4743-8a53-a4e8c97f7f99"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:36.538802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:36.542904 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0bef9f0a-a902-492e-9da1-7bc9fd6789fa req-12dceb12-3239-4a84-92fd-70ced28259a6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.543700 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0bef9f0a-a902-492e-9da1-7bc9fd6789fa req-12dceb12-3239-4a84-92fd-70ced28259a6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.570693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-0bef9f0a-a902-492e-9da1-7bc9fd6789fa req-12dceb12-3239-4a84-92fd-70ced28259a6 service nova] Creating event network-vif-plugged:c6d58bd6-9928-4743-8a53-a4e8c97f7f99 for instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca on hv-cinder-83906 May 26 18:05:36.573196 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ccbe6185-3c93-4419-84f3-332fcc368b55 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236063 May 26 18:05:36.574993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 43/115] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:05:36 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:36.584491 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-0bef9f0a-a902-492e-9da1-7bc9fd6789fa req-12dceb12-3239-4a84-92fd-70ced28259a6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079745 May 26 18:05:36.587084 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 73/116] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:36.695857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:36.698685 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:36.732596 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.738259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.746042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.749529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.762920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:36.769020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:36.810613 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.811901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.814121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:36.820433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:37.150859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:37.166428 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5aec42d5-8887-4f19-85a9-c2d3ddf07880 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.488297 May 26 18:05:37.178022 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 44/117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:36 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:37.822308 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:37.831788 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a599efe7-5807-488c-9999-25ea726c1b9d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 1.077807 May 26 18:05:37.832379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 74/118] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:36 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:38.184509 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:38.185331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:38.192802 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.193494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.194376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.194920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.427719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:38.438294 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0918d2b1-2ea3-42db-8e2b-bbef24a149af tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.256791 May 26 18:05:38.438952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 45/119] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:38 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:38.606852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4ee453da-f1f0-4b7c-8118-a739af901ea2 req-44b186f0-9979-4f91-96b7-5ba3bdf56e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6004051-2831-4f2d-a998-0e4c56354f34", "name": "network-vif-plugged", "status": "completed", "tag": "25a14006-975e-4a8e-9d3d-96f25c4467f0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:38.623934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4ee453da-f1f0-4b7c-8118-a739af901ea2 req-44b186f0-9979-4f91-96b7-5ba3bdf56e28 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.624817 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4ee453da-f1f0-4b7c-8118-a739af901ea2 req-44b186f0-9979-4f91-96b7-5ba3bdf56e28 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.652205 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-4ee453da-f1f0-4b7c-8118-a739af901ea2 req-44b186f0-9979-4f91-96b7-5ba3bdf56e28 service nova] Creating event network-vif-plugged:25a14006-975e-4a8e-9d3d-96f25c4467f0 for instance e6004051-2831-4f2d-a998-0e4c56354f34 on hv-cinder-83906 May 26 18:05:38.662485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4ee453da-f1f0-4b7c-8118-a739af901ea2 req-44b186f0-9979-4f91-96b7-5ba3bdf56e28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061409 May 26 18:05:38.664391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 75/120] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:38.709561 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:38.710581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:38.727160 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.728400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.730185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.731933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.842350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:05:38.869539 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:38.872197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:38.895385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.903326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.905375 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.908261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.021499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-060302c4-dd9c-436b-8bc8-726eb7786f9b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 204 len: 0 microversion: 2.1 time: 0.319667 May 26 18:05:39.029870 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 46/121] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:05:38 2022] DELETE /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:05:39.042015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-d498480a-e14c-416b-8c27-5828f7c0ebd5 req-da9c5ab2-3677-4745-b773-b4452dca075b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8623e13-810b-433d-9e9d-e588bb5781eb", "tag": "52f8b000-2834-4a6a-86b1-591ea06d67c9"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:39.063578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d498480a-e14c-416b-8c27-5828f7c0ebd5 req-da9c5ab2-3677-4745-b773-b4452dca075b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.064360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d498480a-e14c-416b-8c27-5828f7c0ebd5 req-da9c5ab2-3677-4745-b773-b4452dca075b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.080851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-d498480a-e14c-416b-8c27-5828f7c0ebd5 req-da9c5ab2-3677-4745-b773-b4452dca075b service nova] Creating event network-changed:52f8b000-2834-4a6a-86b1-591ea06d67c9 for instance c8623e13-810b-433d-9e9d-e588bb5781eb on hv-cinder-83906 May 26 18:05:39.086853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-d498480a-e14c-416b-8c27-5828f7c0ebd5 req-da9c5ab2-3677-4745-b773-b4452dca075b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053536 May 26 18:05:39.088163 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 47/122] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:39.095417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:39.096381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:39.104976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.105868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.106908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.107357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.197443 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:39.210171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-742b750c-53bd-40d9-b244-cdb93f2c90f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.357881 May 26 18:05:39.211043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 76/123] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:38 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:39.462943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:39.463977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:39.473425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.474304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.475451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.476152 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.640923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:39.654733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a7d72a8d-9548-49c0-9901-839c507f1e61 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.564747 May 26 18:05:39.655771 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 48/124] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:39 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:39.700134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:39.709156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-56563352-94bf-425c-bd0a-7ad5f7c2dc1a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1367 microversion: 2.1 time: 0.250193 May 26 18:05:39.709760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 77/125] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:39 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:40.240501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:40.241168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:40.253615 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.254093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.254922 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.255374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.439146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:40.448365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d7832547-e37e-490a-af97-e0974660edd4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.224242 May 26 18:05:40.448973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 49/126] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:40 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:40.674554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:40.676001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:40.684006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.684516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.685520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.685975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.731947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:40.733874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:40.742342 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.743091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.744117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.744551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.899419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:40.908509 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2915566a-17e8-4cf1-9ac8-a6fbd460d13e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.238644 May 26 18:05:40.909113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 78/127] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:40 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:40.934873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:40.945523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-73c51cf5-f789-4352-8d31-64250c5876c9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1557 microversion: 2.1 time: 0.220842 May 26 18:05:40.946143 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 50/128] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:40 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:40.963563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:40.963889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:40.970938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.971320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.972231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.972705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.071415 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c848077f-016f-4435-9413-c80e49dbcb6b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111813 May 26 18:05:41.072063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 79/129] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:05:40 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:41.469711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:41.470564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:41.477913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.478472 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.479317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.479931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.675005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:41.687273 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-14b07812-5efc-4fb4-91fc-06682192b085 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.222363 May 26 18:05:41.690581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 51/130] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:41 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:41.929814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:41.932319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:41.943889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.944719 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.945438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.946035 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.245060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:42.259730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-698c3d97-3743-46fa-9af9-3c0cabd4b93f tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.337738 May 26 18:05:42.260873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 80/131] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:41 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:42.584459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-0939c8b1-affb-49be-bb92-1724f9b27997 req-71b8fc99-dc56-447b-98a9-331ac856ad9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9288cf08-2b09-4c42-9831-8fbaa8f789ca", "tag": "c6d58bd6-9928-4743-8a53-a4e8c97f7f99"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:42.588822 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:42.595606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0939c8b1-affb-49be-bb92-1724f9b27997 req-71b8fc99-dc56-447b-98a9-331ac856ad9d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.596222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0939c8b1-affb-49be-bb92-1724f9b27997 req-71b8fc99-dc56-447b-98a9-331ac856ad9d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.710614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:42.712047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:42.724717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.725708 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.727518 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.728450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.764351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-0939c8b1-affb-49be-bb92-1724f9b27997 req-71b8fc99-dc56-447b-98a9-331ac856ad9d service nova] Creating event network-changed:c6d58bd6-9928-4743-8a53-a4e8c97f7f99 for instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca on hv-cinder-83906 May 26 18:05:42.771648 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-0939c8b1-affb-49be-bb92-1724f9b27997 req-71b8fc99-dc56-447b-98a9-331ac856ad9d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191651 May 26 18:05:42.772785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 52/132] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:42.987035 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:43.013421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d0233de4-545d-47c8-b5fd-05933c6b57b5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.310318 May 26 18:05:43.014526 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 81/133] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:42 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:43.287272 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:43.288754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:43.297786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:43.299081 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:43.300437 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:43.301112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:43.324190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:43.493399 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:43.505318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0c2d4d10-328f-4fd3-b08a-f18bcb188452 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.223370 May 26 18:05:43.506239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 53/134] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:43 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:44.033947 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:44.035021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:44.042167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.042694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.043480 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.043917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.308486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:44.337319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f2ae35a6-6702-49ec-8386-275ae24a564b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.300972 May 26 18:05:44.340179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 82/135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:44 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:44.534790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:44.536197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:44.548235 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.548763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.549695 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.550239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.735734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:44.744606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d34af492-2413-46fd-8403-39aea67fa43e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.216515 May 26 18:05:44.745242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 54/136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:44 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:45.361796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:45.362658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:45.371657 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.372272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.373362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.374132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.543266 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:45.556885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ecbe23a6-17fe-40c2-8f55-963873a12ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.199240 May 26 18:05:45.557889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 83/137] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:45 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:45.762839 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:45.763535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:45.771090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.771517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.772306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.772739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.940778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:45.949376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ddbd07c2-66c2-423d-96d3-3401fa9c1803 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.190417 May 26 18:05:45.950244 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 55/138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:45 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:46.575298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:46.576135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:46.583366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.583812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.584586 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.585021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.588049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:46.728861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:46.736733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfc84590-fb75-4012-b69a-2499f58011d6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.165449 May 26 18:05:46.737319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 84/139] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:46 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:46.968572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:46.969407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:46.976227 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.976686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.977484 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.977929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.124489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:47.134042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c1439e4-8084-4386-872d-2c27af734b94 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.169346 May 26 18:05:47.136571 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 56/140] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:46 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:47.757845 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.758949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.771522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.772329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.773591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.774110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.917053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:47.925191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-528ed3a8-e753-43d6-9506-f9ada50eed1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.174611 May 26 18:05:47.925859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 85/141] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:47 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:48.153886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:48.154718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:48.164377 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.165202 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.166772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.167614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.333612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:48.341893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8644acdb-0df0-4f64-8154-dfb80bc48959 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.192628 May 26 18:05:48.342517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 57/142] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:48 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:48.951272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:48.954896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:48.962128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.963026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.964665 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.965538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.146796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:49.161453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3af471a8-c5dc-4fc2-b09b-7ab63e93836e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1321 microversion: 2.1 time: 0.222373 May 26 18:05:49.162721 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 86/143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:48 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:49.363119 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:49.363958 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:49.370108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.370773 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.371811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.372467 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.960843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:49.976322 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b338cd40-e55b-4db9-8643-5d781eee3134 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1553 microversion: 2.1 time: 0.617875 May 26 18:05:49.977304 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 58/144] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:49 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1553 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:50.193603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:50.194827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:50.207468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.208194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.209797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.210487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.544081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:50.557001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d13cd0b-a8d1-409a-8620-004d664ceccd tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1515 microversion: 2.1 time: 0.375537 May 26 18:05:50.557001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 87/145] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:50 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:50.579454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2268c0cc-202e-421a-962a-697d415f2ca8 req-92d63d60-75ba-4e20-a364-a9e90d6495f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664374d-3fde-4a0f-b37c-4eed1d6e487e", "name": "network-vif-unplugged", "status": "completed", "tag": "a005425b-e20a-47bb-9ff2-fd8bbe43e0c3"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:50.587190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:50.588747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:50.595586 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.596044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.596944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.597394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.598498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2268c0cc-202e-421a-962a-697d415f2ca8 req-92d63d60-75ba-4e20-a364-a9e90d6495f5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.600769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2268c0cc-202e-421a-962a-697d415f2ca8 req-92d63d60-75ba-4e20-a364-a9e90d6495f5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.634120 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'flavor' on Instance uuid e6004051-2831-4f2d-a998-0e4c56354f34 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:50.648788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2268c0cc-202e-421a-962a-697d415f2ca8 req-92d63d60-75ba-4e20-a364-a9e90d6495f5 service nova] Creating event network-vif-unplugged:a005425b-e20a-47bb-9ff2-fd8bbe43e0c3 for instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e on hv-cinder-83906 May 26 18:05:50.663453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2268c0cc-202e-421a-962a-697d415f2ca8 req-92d63d60-75ba-4e20-a364-a9e90d6495f5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089939 May 26 18:05:50.664326 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 59/146] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:50.814058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f864743f-7bff-4ec5-a906-02d4c8f7afbf tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34/action" status: 200 len: 32 microversion: 2.1 time: 0.232246 May 26 18:05:50.814730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 88/147] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:05:50 2022] POST /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:05:50.836774 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:50.850074 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:50.873935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.875934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.878463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.881252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.017889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:51.020707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:51.033085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.033550 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.034404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.034852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.153153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:51.170771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a03bb074-5297-4ca3-a702-385aed712e40 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1511 microversion: 2.1 time: 0.159904 May 26 18:05:51.171871 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 89/148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:51 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:51.196948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-345dd2cb-0948-48f6-b7d5-9fec501b33c4 req-b1f0525e-5f54-4309-9ae1-bf06de64fa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664374d-3fde-4a0f-b37c-4eed1d6e487e", "name": "network-vif-deleted", "tag": "a005425b-e20a-47bb-9ff2-fd8bbe43e0c3"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:51.208269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-345dd2cb-0948-48f6-b7d5-9fec501b33c4 req-b1f0525e-5f54-4309-9ae1-bf06de64fa5b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.208715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-345dd2cb-0948-48f6-b7d5-9fec501b33c4 req-b1f0525e-5f54-4309-9ae1-bf06de64fa5b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.222247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-345dd2cb-0948-48f6-b7d5-9fec501b33c4 req-b1f0525e-5f54-4309-9ae1-bf06de64fa5b service nova] Creating event network-vif-deleted:a005425b-e20a-47bb-9ff2-fd8bbe43e0c3 for instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e on hv-cinder-83906 May 26 18:05:51.228067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-345dd2cb-0948-48f6-b7d5-9fec501b33c4 req-b1f0525e-5f54-4309-9ae1-bf06de64fa5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035788 May 26 18:05:51.229103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 90/149] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:51.264065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:51.274677 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-779a40ee-333a-443f-9124-849f5f9706ff tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.452502 May 26 18:05:51.275395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 60/150] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:50 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:52.196404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.197166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:52.205843 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.206421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.207357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.207856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.278870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:52.290265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e6fc337f-04f9-4a6d-863f-6261a497018b tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1346 microversion: 2.1 time: 0.096329 May 26 18:05:52.290265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 91/151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:52 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:52.304537 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.305475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:52.314757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.315294 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.316237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.316929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.584408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:52.592242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-02c9cdec-6fdf-4f05-8ef3-335a737aa269 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.291769 May 26 18:05:52.592830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 61/152] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:52 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:53.308839 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.310173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.320029 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.320622 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.322001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.322647 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.362835 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.363279 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.363735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lazy-loading 'fault' on Instance uuid 1664374d-3fde-4a0f-b37c-4eed1d6e487e {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:53.422940 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b8f193d3354e9784dc62bbae040e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b746bd093c749c5a2ffe6fd3d3e0417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:53.432119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3cf169d5-9a07-4c3a-9adf-e1e8301ef075 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 200 len: 1351 microversion: 2.1 time: 0.129104 May 26 18:05:53.432734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 92/153] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:53.615521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.616472 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.625943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.626548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.627850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.628643 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.795417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:53.815281 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-423c6d29-5082-4082-a638-9cf37b0cac1e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.206346 May 26 18:05:53.816588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 62/154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:54.458097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.460754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.466868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.467284 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.468148 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.468928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.491532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] HTTP exception thrown: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Request method failure captured: May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e HTTP/1.1 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E79OE_k0gw0jQDF3DM-x9HNR95P02s2KRo7BpyVhMoJN8wPKG3I0DCyNK-T4Ts13re0Lit-jed_99GtUv1_jlBr5S16O5r3Oe9PzLlkMU4qZjdgkBEr6y5xG5I9QVFT3zwICB7burMDiolhg80tBXL5S8_wVNt-KPg-V33Tk-CH9g May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:05:54.500470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 81b8f193d3354e9784dc62bbae040e72 May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.502407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '1664374d-3fde-4a0f-b37c-4eed1d6e487e'} May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:54.503360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.504804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:54.506028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Returning 404 to user: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:54.506028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-65c8c54c-c0bc-4ad0-9dcc-6cfc4f2062b0 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 404 len: 111 microversion: 2.1 time: 0.051364 May 26 18:05:54.506646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 93/155] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:54.628981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.629925 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.643435 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.643908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.644721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.645146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.661413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] HTTP exception thrown: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Request method failure captured: May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e/os-volume_attachments HTTP/1.1 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8E79OE_k0gw0jQDF3DM-x9HNR95P02s2KRo7BpyVhMoJN8wPKG3I0DCyNK-T4Ts13re0Lit-jed_99GtUv1_jlBr5S16O5r3Oe9PzLlkMU4qZjdgkBEr6y5xG5I9QVFT3zwICB7burMDiolhg80tBXL5S8_wVNt-KPg-V33Tk-CH9g May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:05:54.665455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 81b8f193d3354e9784dc62bbae040e72 May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.666882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '1664374d-3fde-4a0f-b37c-4eed1d6e487e'} May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:54.667631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:54.668711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:54.669965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Returning 404 to user: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:54.669965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7cdd6a34-0ec4-4564-bc93-5f9311958f4e tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042637 May 26 18:05:54.669965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 63/156] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:54.838146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.838791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.845566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.846015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.846826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.847263 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.998971 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:55.009731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-914e5edd-70d3-4dea-a763-2987ef0cff40 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.175319 May 26 18:05:55.010705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 94/157] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:56.035500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:56.036648 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:56.047698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.048519 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.049893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.050735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.238083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.248370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-05efd24e-fe81-474e-86d4-ae6f83a9efdb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.221418 May 26 18:05:56.248975 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 64/158] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:56 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:56.961744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:56.962447 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:56.970867 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.971184 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.972135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.972574 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.989850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] HTTP exception thrown: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Request method failure captured: May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e HTTP/1.1 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8E79OE_k0gw0jQDF3DM-x9HNR95P02s2KRo7BpyVhMoJN8wPKG3I0DCyNK-T4Ts13re0Lit-jed_99GtUv1_jlBr5S16O5r3Oe9PzLlkMU4qZjdgkBEr6y5xG5I9QVFT3zwICB7burMDiolhg80tBXL5S8_wVNt-KPg-V33Tk-CH9g May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:05:56.991454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-113582191 May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 81b8f193d3354e9784dc62bbae040e72 May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:56.992886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '1664374d-3fde-4a0f-b37c-4eed1d6e487e'} May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:56.993697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:56.994920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:05:56.996173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Returning 404 to user: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:56.996173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1677e0ec-0f94-490d-a1a2-aaf9f79325cd tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 404 len: 111 microversion: 2.1 time: 0.035080 May 26 18:05:56.996173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 95/159] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:05:56 2022] DELETE /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:57.001986 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:57.002719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] [instance: 1664374d-3fde-4a0f-b37c-4eed1d6e487e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:57.008859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.009317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.010087 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.010575 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.024515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] HTTP exception thrown: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Request method failure captured: May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e HTTP/1.1 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8E79OE_k0gw0jQDF3DM-x9HNR95P02s2KRo7BpyVhMoJN8wPKG3I0DCyNK-T4Ts13re0Lit-jed_99GtUv1_jlBr5S16O5r3Oe9PzLlkMU4qZjdgkBEr6y5xG5I9QVFT3zwICB7burMDiolhg80tBXL5S8_wVNt-KPg-V33Tk-CH9g May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:05:57.026782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6b746bd093c749c5a2ffe6fd3d3e0417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-113582191 May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 6b746bd093c749c5a2ffe6fd3d3e0417 May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-113582191 May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 81b8f193d3354e9784dc62bbae040e72 May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-113582191-project May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:57.028211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '1664374d-3fde-4a0f-b37c-4eed1d6e487e'} May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:57.029184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. May 26 18:05:57.031240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:05:57.032285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] Returning 404 to user: Instance 1664374d-3fde-4a0f-b37c-4eed1d6e487e could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:57.032285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-37419768-c16c-451d-a6c5-e7070f651387 tempest-DeleteServersTestJSON-113582191 tempest-DeleteServersTestJSON-113582191-project] 10.222.0.76 "GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e" status: 404 len: 111 microversion: 2.1 time: 0.030457 May 26 18:05:57.033180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 65/160] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:56 2022] GET /compute/v2.1/servers/1664374d-3fde-4a0f-b37c-4eed1d6e487e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:57.267168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:57.267805 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:57.274849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.275642 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.276405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.277102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.764180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.773282 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9d83ad9-3240-4e23-a349-9d9bec324828 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.509960 May 26 18:05:57.774230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 96/161] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:57 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:58.797042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:58.797042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:58.808922 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.809600 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.811006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.812722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.063516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:59.073614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9a134c23-101b-450c-9236-5d88249757ca tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.285288 May 26 18:05:59.074957 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 66/162] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:05:58 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:00.094505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:00.095126 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.107397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.107923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.110541 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.111297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.390378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:00.400831 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-170a7928-af01-43dc-9ab2-d66643dd6d59 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.313314 May 26 18:06:00.411086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 97/163] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:00 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:01.420282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:01.422790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:01.429402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.430146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.431163 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.431778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.627933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.636263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8b859e6b-3908-404e-a036-1c1ed4d7dd9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.221229 May 26 18:06:01.637352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 67/164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:01 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:02.656685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.657955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:02.665050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.665501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.666352 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.667360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.931293 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:02.950035 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cddf3c20-41cc-4212-8c8a-a29e5b5f7a79 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.297900 May 26 18:06:02.951453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 98/165] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:02 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:03.981747 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.982988 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.993261 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.994415 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.995770 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.996515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:04.172179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:04.195623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b0cda94f-d0e1-463b-b4f4-8540b50a710f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.220682 May 26 18:06:04.197125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 68/166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:03 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:05.214798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:05.215547 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:05.223646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.224434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.225353 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.226081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.461582 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:05.470322 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3eb02d9c-bf6f-4a16-bcc8-eaf251b4e913 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.261027 May 26 18:06:05.471247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 99/167] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:05 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:06.502664 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:06.504281 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:06.521357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.522287 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.523848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.524432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.708827 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:06.717002 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-04f6bcef-e785-442d-9fee-dfbf995c22b2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.228904 May 26 18:06:06.718757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 69/168] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:06 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:07.745065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:07.746166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:07.759402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=56 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:07.769951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.770783 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.772116 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.773124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.810681 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:07.983066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:07.993104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd77bf1a-ef6b-4985-b7eb-4ae254534114 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.253659 May 26 18:06:07.993693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 100/169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:07 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:09.013233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:09.014405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:09.022553 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.022990 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.023788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.024225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.225138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:09.237951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aa592b9f-34ec-4db9-803a-5ec800d5be60 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.230335 May 26 18:06:09.251818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 70/170] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:09 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:10.266105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:10.268484 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:10.280422 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.282005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.283615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.284910 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.489589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:10.506707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ed5930af-a36f-4907-897a-34b49163b572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.247440 May 26 18:06:10.508421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 101/171] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:10 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:11.529312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:11.536524 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:11.551501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.552589 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.553668 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.554476 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.820939 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:11.838823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-90395b44-ca54-434e-a0f9-e29e4c9ad8f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.316077 May 26 18:06:11.839719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 71/172] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:11 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:12.865230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:12.865983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:12.873655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.874250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.875072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.875526 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.087894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.102514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e6630d3-c84a-4e78-82ea-42815a16d9ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.240729 May 26 18:06:13.103608 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 102/173] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:12 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:14.126131 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:14.127386 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:14.130333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=40 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:14.149853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.150357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.151157 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.151628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.157153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:14.325637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:14.349414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5622d267-2d3b-4694-b4c7-5d09b245c0ba tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.228289 May 26 18:06:14.360017 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 72/174] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:14 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:15.369798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:15.372356 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:15.382919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.385028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.386142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.386893 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.584713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:15.597657 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34e7c7af-6ca1-4316-b3b1-81a42be43f39 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.233478 May 26 18:06:15.598738 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 103/175] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:15 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:16.616193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.616939 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.637764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.638325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.639199 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.640285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.804025 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.814070 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-048f07c4-e0c6-4005-a2f9-98d8b61cdb9e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.202614 May 26 18:06:16.827450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 73/176] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:16 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:17.841283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:17.842079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:17.863206 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.867176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.870736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.876811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.133145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.152009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0888db85-cd21-48c9-b7e7-739ad766ad83 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.314444 May 26 18:06:18.170863 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 104/177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:17 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:19.180044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:19.180869 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:19.188073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.188527 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.189444 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.189890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.419740 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:19.437409 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8ff6659-7aa5-4805-81d5-ec46e471f2a9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.260932 May 26 18:06:19.448912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 74/178] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:19 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:20.466450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:20.467018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:20.473970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.474452 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.475232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.475664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.623353 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.631903 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e66b48c-d7ad-48e4-9b74-b6cf522cc52a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.169360 May 26 18:06:20.632593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 105/179] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:20 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:21.657110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:21.657730 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:21.664105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.664556 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.665331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.665763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.810789 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.819706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1b6179e2-afcd-4922-925b-5693e67aa276 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.166729 May 26 18:06:21.820298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 75/180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:21 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:22.838425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.839028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:22.845917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.846418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.847206 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.847644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.990327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:22.998397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a73bd9c2-9205-4635-ac9c-03791e078017 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.163796 May 26 18:06:22.999650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 106/181] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:22 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:24.015740 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:24.016361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:24.024180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.024629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.025439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.025873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.211745 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:24.220115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-29610714-53dd-4cb8-acaf-5aa55716b78f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.208254 May 26 18:06:24.220708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 76/182] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:24 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:25.238055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:25.239001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:25.247164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:25.247632 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:25.248616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:25.249401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:25.401095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:25.409716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-679ec5f1-e9f5-4028-808c-7564cc569d0a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.176579 May 26 18:06:25.410340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 107/183] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:25 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:26.428548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-613477253", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:26.432084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:26.433221 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:26.447995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.448675 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.450839 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.452208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.504581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] validate_networks() for None {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:26.700992 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:26.711844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-21a02f49-1650-44ae-aef6-7ec8f24a3ee1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.287792 May 26 18:06:26.713254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 77/184] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:26 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:26.902787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:26.903608 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:26.904320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:26.905833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:26.906440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:26.924098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.924555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.925656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.926090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.946816 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Getting quotas for project 799f6c254b56426e89102354e6274b18. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:26.953432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Getting quotas for user d9790a81d03741688e45948876714cb4 and project 799f6c254b56426e89102354e6274b18. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:26.967839 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:26.971044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:27.026717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07f50895-9db6-4e47-ac9e-b29a422274bf tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602686 May 26 18:06:27.027391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 108/185] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:06:27.038308 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6ebca47c-4b47-4a9b-a294-b519f44483fd tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.038944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6ebca47c-4b47-4a9b-a294-b519f44483fd tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.107435 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6ebca47c-4b47-4a9b-a294-b519f44483fd tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.116015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6ebca47c-4b47-4a9b-a294-b519f44483fd tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1214 microversion: 2.1 time: 0.081637 May 26 18:06:27.126873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 78/186] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:27.747751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.749731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.760979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.761764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.763176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.763966 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.968658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.983555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-561628fe-11b5-412d-a4bf-4ea355a0337a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.243895 May 26 18:06:27.985855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 109/187] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:28.147498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:28.148752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:28.157093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:28.157523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:28.158581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:28.159024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:28.264008 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:28.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00581008-c02e-4cf0-98f6-277fababae36 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1266 microversion: 2.1 time: 0.139665 May 26 18:06:28.277086 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 79/188] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:28 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:29.005270 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:29.005994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:29.018951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.022080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.023687 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.024322 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.294405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:29.295040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:29.327027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:29.334754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.338468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.340037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.341062 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.360212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-71df23a9-eee3-4d3d-9442-6aedc5da77ea tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.356944 May 26 18:06:29.360877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 110/189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:28 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:29.446528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:29.471683 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9dc7a315-e681-4772-829f-a1af967f2a85 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1272 microversion: 2.1 time: 0.180981 May 26 18:06:29.473078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 80/190] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:29 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:30.378336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:30.378985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:30.386222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.386934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.387889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.389392 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.489996 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:30.492577 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:30.505810 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.507960 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.511951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.512724 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.687157 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:30.704809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2eaf17e7-78be-4971-ba80-e660961bb77d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.330908 May 26 18:06:30.718230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 111/191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:30 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:30.967842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:31.002125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5425afdd-0eed-4633-89b3-a61056ed9b55 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.515432 May 26 18:06:31.003698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 81/192] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:30 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:31.728782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-213e2a94-85aa-4ad9-afd3-5fc1d174c249 req-d7ff45ab-18f1-478e-8f4e-c8485fb84427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08edabe5-6608-4245-816d-b432ff403775", "tag": "60a8c52a-f764-4c9e-a08a-f51f9aaab5c6"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:31.737412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:31.741777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:31.780871 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.781643 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.783133 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.784035 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.791291 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-213e2a94-85aa-4ad9-afd3-5fc1d174c249 req-d7ff45ab-18f1-478e-8f4e-c8485fb84427 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.796677 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-213e2a94-85aa-4ad9-afd3-5fc1d174c249 req-d7ff45ab-18f1-478e-8f4e-c8485fb84427 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.891121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-213e2a94-85aa-4ad9-afd3-5fc1d174c249 req-d7ff45ab-18f1-478e-8f4e-c8485fb84427 service nova] Creating event network-changed:60a8c52a-f764-4c9e-a08a-f51f9aaab5c6 for instance 08edabe5-6608-4245-816d-b432ff403775 on hv-cinder-83906 May 26 18:06:31.919105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-213e2a94-85aa-4ad9-afd3-5fc1d174c249 req-d7ff45ab-18f1-478e-8f4e-c8485fb84427 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199517 May 26 18:06:31.925225 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 112/193] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:32.045551 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:32.049511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:32.064519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.065469 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.066537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.067292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.270679 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:32.281149 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-108ffacf-9d35-4326-b40a-bdfeb332693b tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.255025 May 26 18:06:32.282938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 113/194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:32 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:32.357365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:32.370985 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-97b4e7c5-4ea9-4edd-bde2-5eaf74fe1e47 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.640860 May 26 18:06:32.373288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 82/195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:31 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:33.303481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:33.304256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:33.317657 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.318129 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.320009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.322221 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.394292 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:33.396529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:33.412690 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.414163 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.416307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.417781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.535246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:33.549346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab14fcbc-513c-430d-8665-7ffe00ab3705 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.249891 May 26 18:06:33.550063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 114/196] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:33 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:33.673157 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:33.690004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-60e721ef-c7e2-43c0-8cac-e89933397588 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.302228 May 26 18:06:33.690701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 83/197] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:33 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:34.566896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:34.567505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:34.575078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:34.575450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.576228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:34.577525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.710741 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:34.711510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:34.719747 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:34.720319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.721604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:34.722270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.747468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:34.778528 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c54bc567-c8da-42c3-8678-6c12554e1a97 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.215294 May 26 18:06:34.779618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 115/198] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:34 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:34.887785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:34.901214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-64c52ea1-cd8a-409f-8eb9-3c554528b60c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1521 microversion: 2.1 time: 0.195983 May 26 18:06:34.902567 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 84/199] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:34 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:35.798236 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:35.799466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:35.807249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.808297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.809093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.809686 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.923628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:35.924255 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:35.934004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.934489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.935273 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.935861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.011485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:36.020220 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-76c38552-2725-40cc-b13f-d8e1fc347107 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.226352 May 26 18:06:36.023664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 116/200] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:35 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:36.186554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:36.206553 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-23c8c2ae-7731-4083-bb2d-b0e2b968a09c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1501 microversion: 2.1 time: 0.289762 May 26 18:06:36.208610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 85/201] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:35 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:36.227585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:36.228389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:36.235703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.236384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.237352 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.238042 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.398235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:36.407438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e0e63615-9c95-42f2-8470-bc32689aeb84 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1515 microversion: 2.1 time: 0.187120 May 26 18:06:36.408194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 117/202] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:36 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:37.040023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:37.041475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:37.052370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.053102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:37.054228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.055099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:37.118983 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:37.321298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:37.330324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2b870c15-1240-4322-9729-1dfaa6337947 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.295571 May 26 18:06:37.330920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 86/203] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:37 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:37.979659 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:37.980906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:37.992722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:37.993416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:37.994639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:37.997600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.998355 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.000225 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.001214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.008014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:38.031075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'flavor' on Instance uuid b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:38.104328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6251ea45-9b04-4599-bdad-c81949d9025e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/action" status: 200 len: 32 microversion: 2.1 time: 0.128699 May 26 18:06:38.104983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 118/204] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:06:37 2022] POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:06:38.115857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:38.116483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:38.122651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.123215 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.124143 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.124594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.349398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:38.350107 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:38.357497 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.357961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.358780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.359229 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.365348 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:38.374564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1371ddee-fd5a-4180-98ad-d9e51aa44c0d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.263247 May 26 18:06:38.375632 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 87/205] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:38 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:38.508628 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:38.521336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bb2ca0da-b5fc-4daa-bbd4-c71162e34e3e tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.176073 May 26 18:06:38.522060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 119/206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:38 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:38.729050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:38.729543 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:38.745734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.746211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.746984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.747418 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.777388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2c81a9a-b93d-40b7-a924-f4434bcc1de0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.052052 May 26 18:06:38.778231 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 88/207] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:06:38 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:38.795300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1781e8d0-d608-48be-9fc2-ef1471e4f53b req-44110b0a-f96c-41d0-abec-96afb66679e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08edabe5-6608-4245-816d-b432ff403775", "name": "network-vif-plugged", "status": "completed", "tag": "60a8c52a-f764-4c9e-a08a-f51f9aaab5c6"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:38.824250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1781e8d0-d608-48be-9fc2-ef1471e4f53b req-44110b0a-f96c-41d0-abec-96afb66679e5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.825407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1781e8d0-d608-48be-9fc2-ef1471e4f53b req-44110b0a-f96c-41d0-abec-96afb66679e5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.855000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1781e8d0-d608-48be-9fc2-ef1471e4f53b req-44110b0a-f96c-41d0-abec-96afb66679e5 service nova] Creating event network-vif-plugged:60a8c52a-f764-4c9e-a08a-f51f9aaab5c6 for instance 08edabe5-6608-4245-816d-b432ff403775 on hv-cinder-83906 May 26 18:06:38.867344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1781e8d0-d608-48be-9fc2-ef1471e4f53b req-44110b0a-f96c-41d0-abec-96afb66679e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079204 May 26 18:06:38.867961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 120/208] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:39.392504 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:39.393120 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:39.399808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.400267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.401117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.401569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.546427 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:39.548379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:39.559034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.559795 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.561102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.561844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.579997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:39.588508 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d63ad63b-263c-4b85-ac41-2aae735d56f1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.200014 May 26 18:06:39.589185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 89/209] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:39 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:39.760599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:39.769558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-822e0190-828e-4d82-815c-7c44de970b6f tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1314 microversion: 2.1 time: 0.232568 May 26 18:06:39.770163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 121/210] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:39 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:40.308459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ac5aa0-9184-4099-a806-dc70d2bba06a"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:40.309592 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.316807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.317252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.318226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.318812 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.321626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:40.628467 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.629217 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.644899 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.645969 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.647097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.647570 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.843002 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:40.857658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c4505247-3d19-4473-8d8a-a2025bbf90e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.242163 May 26 18:06:40.859513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 122/211] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:40.865557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.866695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.873685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.874144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.875013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.875445 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.067195 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:41.075019 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2304e15f-2930-4d68-990b-aadd9d638ac2 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1463 microversion: 2.1 time: 0.214346 May 26 18:06:41.075603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 123/212] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1463 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:41.122961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.125315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.130549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.131321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.132314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.132962 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.173204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:41.281878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-944262f8-ee55-46f4-8b91-e01c53de5bd7 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "DELETE /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 204 len: 0 microversion: 2.1 time: 0.162244 May 26 18:06:41.282612 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 124/213] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:06:41 2022] DELETE /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:06:41.291071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.293641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.301129 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.301595 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.302448 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.303359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.483744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:41.494297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e49fb268-6812-4907-914b-fee037640342 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1469 microversion: 2.1 time: 0.207192 May 26 18:06:41.494955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 125/214] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:41 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:41.876978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.877673 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.884535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.885001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.885854 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.886333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.059760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.069149 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3dbea027-95e8-48d2-b93d-ddfbc8e4a377 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.196891 May 26 18:06:42.069744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 126/215] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:41 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:42.512881 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:42.513808 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:42.523993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.525087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.526771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.527412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.718321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.726121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0bc77fa5-a312-4ab3-846e-f8860f64c3d5 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1469 microversion: 2.1 time: 0.217383 May 26 18:06:42.726750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 127/216] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:42 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:43.087298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:43.088006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:43.097152 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.097663 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.098580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.099492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.146474 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cf83e71c-d536-40e5-8c3c-9ea39b4ee5da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.841720 May 26 18:06:43.148031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 90/217] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:06:40 2022] POST /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments => generated 194 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:43.289323 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:43.297757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a739447-f3ee-491b-b0b5-184725ce4fc1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.215070 May 26 18:06:43.298459 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 128/218] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:43 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:43.746446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:43.747350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:43.762516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.763888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.766030 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.766571 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.298688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.310331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6868039-2688-4e57-96f3-3cf9087b52da tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1469 microversion: 2.1 time: 0.567360 May 26 18:06:44.316793 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:44.318016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:44.323365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 91/219] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:43 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:44.338925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.339739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.340699 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.341288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.495736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.505769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2e8e11c-58a2-48a3-849c-5df841200655 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.195066 May 26 18:06:44.507063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 129/220] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:44 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:44.555447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-91db111d-30dd-409c-9990-2c1234676a64 req-63e47057-8951-429f-bf8e-7708268da0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08edabe5-6608-4245-816d-b432ff403775", "name": "network-vif-deleted", "tag": "60a8c52a-f764-4c9e-a08a-f51f9aaab5c6"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:44.561591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=42 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:44.565373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:44.565882 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:44.566957 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-91db111d-30dd-409c-9990-2c1234676a64 req-63e47057-8951-429f-bf8e-7708268da0f7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.567400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-91db111d-30dd-409c-9990-2c1234676a64 req-63e47057-8951-429f-bf8e-7708268da0f7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.572009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.572500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.573283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.573730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.584509 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-91db111d-30dd-409c-9990-2c1234676a64 req-63e47057-8951-429f-bf8e-7708268da0f7 service nova] Creating event network-vif-deleted:60a8c52a-f764-4c9e-a08a-f51f9aaab5c6 for instance 08edabe5-6608-4245-816d-b432ff403775 on hv-cinder-83906 May 26 18:06:44.596929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-91db111d-30dd-409c-9990-2c1234676a64 req-63e47057-8951-429f-bf8e-7708268da0f7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045166 May 26 18:06:44.599056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 92/221] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:44.608794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6f3e479-3337-49fc-a343-80d5b29f0c56 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/ips" status: 200 len: 146 microversion: 2.1 time: 0.047552 May 26 18:06:44.610128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 130/222] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:06:44 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:45.332253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:45.332253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:45.338965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.339589 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.340746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.341296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.390285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.390891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.391458 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lazy-loading 'fault' on Instance uuid 08edabe5-6608-4245-816d-b432ff403775 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:45.449369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9790a81d03741688e45948876714cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799f6c254b56426e89102354e6274b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.457726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-94d39acf-6300-4fde-aee1-71881326ee01 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 200 len: 1304 microversion: 2.1 time: 0.132419 May 26 18:06:45.458479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 93/223] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:45 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:45.523513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:45.524289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:45.532341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.533127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.533911 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.534629 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.760020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.769248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-872f4c69-e2ea-49fd-b787-f7b18440f406 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.249128 May 26 18:06:45.770163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 131/224] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:45 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:46.474835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:46.475522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] [instance: 08edabe5-6608-4245-816d-b432ff403775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:46.482007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.482831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.483791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.484201 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.498983 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] HTTP exception thrown: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Request method failure captured: May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 HTTP/1.1 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8GcpAFMRn4HALihOct3z8_FpRetSlZvM-bUn124iWFO6aUlR3odTcUok57In08GblqYvyCw0dQ_FnpB4yxRUR59lS3njzLs6njuJ7JHflcJMbnJ5aw3Xch4YQV6Ukn6g565YIWKIlcsv76v0JDret77ueXoG6KJtIbSz8KbBppbrwM May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 799f6c254b56426e89102354e6274b18 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-972695762 May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:06:46.500967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/799f6c254b56426e89102354e6274b18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/799f6c254b56426e89102354e6274b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/799f6c254b56426e89102354e6274b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_799f6c254b56426e89102354e6274b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-972695762 May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 799f6c254b56426e89102354e6274b18 May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-972695762 May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-972695762-project May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: d9790a81d03741688e45948876714cb4 May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-972695762-project May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. May 26 18:06:46.502224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '08edabe5-6608-4245-816d-b432ff403775'} May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:46.503076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. May 26 18:06:46.511498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:06:46.512652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] Returning 404 to user: Instance 08edabe5-6608-4245-816d-b432ff403775 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:46.512652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-20bd9af1-8f83-4d34-90cc-323a59de2e27 tempest-VolumesNegativeTest-972695762 tempest-VolumesNegativeTest-972695762-project] 10.222.0.76 "GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775" status: 404 len: 111 microversion: 2.1 time: 0.031784 May 26 18:06:46.512652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 94/225] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:46 2022] GET /compute/v2.1/servers/08edabe5-6608-4245-816d-b432ff403775 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:06:46.787876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:46.788579 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:46.796218 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.796948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.797776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.798235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.821669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:47.015477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:47.024849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88861183-4097-4ef9-b934-85665a272d8a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.240630 May 26 18:06:47.036052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 132/226] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:46 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:47.203333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "050b17a8-0c07-49a1-a42b-15853bcf1d84"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:47.204554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:47.210835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.211382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.212218 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.212658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.582627 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7654cd17-85b3-4136-941f-a105c59a22ad tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383748 May 26 18:06:47.584337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 95/227] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:06:47 2022] POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:48.043372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:48.044185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:48.055408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.058660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.059764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.062079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.511873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:48.528792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8adade6d-0523-4f52-8cc0-23dfb735ce23 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.489153 May 26 18:06:48.539792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 133/228] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:48 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:49.550362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:49.552309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:49.557799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.558280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.559057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.559494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.767181 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:49.777410 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f3abef24-c345-460e-a1b4-d5a239036cb7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.232815 May 26 18:06:49.778465 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 96/229] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:49 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:50.800356 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:50.800998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:50.808057 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.808522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.810547 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.812294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.880003 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3e943443-4cf8-497f-aa22-1d2f31ed84fd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: .version_select at 0x7f1fa0497940>, body: {"keypair": {"name": "tempest-keypair-1293654871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqfosPkCtVJbVXOKSKReYiUIw0hB2EeeC/F3nXaWjywurGfnZ7+OzTSagfXR3Nvvp04QzRbjBckm7IbP+2ZfFLX5HLzyJ3/dDOE55UhmLX4XMMCoASvg6Fc4Av6tyIzdg=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:50.904061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-3e943443-4cf8-497f-aa22-1d2f31ed84fd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:50.911145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-3e943443-4cf8-497f-aa22-1d2f31ed84fd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:50.955149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3e943443-4cf8-497f-aa22-1d2f31ed84fd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079380 May 26 18:06:50.960945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 97/230] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:06:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:51.034878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.045354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1281f194-5a56-4029-8fe4-e8a9b57db167 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.252026 May 26 18:06:51.057880 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 134/231] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:50 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:52.066748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:52.067392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:52.079751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.080207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.086564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.087937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.677907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:52.689547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4447c672-5c8e-4896-9b23-ba0a1370a477 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.628842 May 26 18:06:52.724909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 98/232] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:52 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:53.249889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2011074468", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88540240-a343-4b80-bbe6-aa98a82d692f"}], "security_groups": [{"name": "tempest-securitygroup--1471320286"}], "key_name": "tempest-keypair-1293654871", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:53.544109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] validate_networks() for [('88540240-a343-4b80-bbe6-aa98a82d692f', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:53.709338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:53.710054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:53.719424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.720103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.721124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.721791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.952755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:53.963989 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b0824532-c79a-4fed-9079-5004f688564d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.259185 May 26 18:06:53.965153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 99/233] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:53 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:54.333762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:54.334308 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:54.334703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:54.335375 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:54.336151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:54.348571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.349176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.350154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.350745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.409155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:54.418866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:54.439795 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:54.442736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:54.523282 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9f12fd07-abcf-4273-ba0a-78689aebbe8d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.280482 May 26 18:06:54.534606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 135/234] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:06:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:06:54.535775 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b3f9f83c-7e40-47ac-a33a-f4ab58f14a0b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:54.536835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b3f9f83c-7e40-47ac-a33a-f4ab58f14a0b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:54.607853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b3f9f83c-7e40-47ac-a33a-f4ab58f14a0b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.615516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b3f9f83c-7e40-47ac-a33a-f4ab58f14a0b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1242 microversion: 2.1 time: 0.083595 May 26 18:06:54.617450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 100/235] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:54 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:54.983914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:54.985021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:54.994169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.994842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.995762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.996330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.274381 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.287886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e223ba7a-5f94-4033-9cb7-6f3b9171d3e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.308516 May 26 18:06:55.305410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 136/236] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:54 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:55.638541 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.640515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:55.650068 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.652708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.656551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.657852 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.897485 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.913709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-745e0ecd-fec4-4da2-a3ef-eb350603a95b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1294 microversion: 2.1 time: 0.280541 May 26 18:06:55.925829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 101/237] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:55 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1294 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:56.307341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:56.307894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:56.322935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.323410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:56.339974 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.340585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:56.619551 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:56.631032 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-04f02bf1-7606-4c49-aa10-0c008939d349 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.328300 May 26 18:06:56.631929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 137/238] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:56 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:56.940778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:56.942023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:56.949086 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.949804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:56.950800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.951963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:57.120599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:57.145830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a53e954e-cfed-45c2-95c6-f93c071a4dd3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1300 microversion: 2.1 time: 0.217609 May 26 18:06:57.146476 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 102/239] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:56 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1300 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:57.650837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:57.651759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:57.675413 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:57.692772 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:57.694049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:57.696069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.039578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.057175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b0207250-d7b6-4c48-a609-26b74fe813a0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.412474 May 26 18:06:58.057978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 138/240] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:57 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:58.169518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:58.174592 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:58.182253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.183025 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.183831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.184170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.272024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.283447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5325b53a-317a-43d8-84a8-8c3511d17586 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1300 microversion: 2.1 time: 0.120536 May 26 18:06:58.284557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 103/241] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:58 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:59.077431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:59.078039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:59.086573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.087027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.093705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.094567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.304976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:59.305626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:59.312193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.319424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.320397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.320863 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.511256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:59.536196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9fd982c1-97a4-4e45-80db-89c39e8df599 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.462600 May 26 18:06:59.538911 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 139/242] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:59 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:00.199684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:00.211651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-104d362d-3670-48c1-a978-2ca8d52c33c2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.914437 May 26 18:07:00.216292 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 104/243] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:06:59 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:00.556090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:00.557477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:00.569495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.570890 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.573384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.574582 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.067465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:01.088525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d092a0ee-6beb-4c41-939e-212a91737bd2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.535863 May 26 18:07:01.089336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 140/244] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:00 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:01.157540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b46e5a96-4b45-46c7-b639-32c527506068 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:01.168886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b46e5a96-4b45-46c7-b639-32c527506068 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.169338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b46e5a96-4b45-46c7-b639-32c527506068 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.233731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:01.234794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:01.245168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.245626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.246645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.246878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.260425 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b46e5a96-4b45-46c7-b639-32c527506068 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Going to try to stop instance {{(pid=117833) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:07:01.391128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b46e5a96-4b45-46c7-b639-32c527506068 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action" status: 202 len: 0 microversion: 2.1 time: 0.240937 May 26 18:07:01.398269 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 105/245] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:07:01 2022] POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:01.414485 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:01.417520 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:01.432708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.433523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.441260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.442952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.447339 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.604989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:01.615742 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3fe4800e-c369-4d49-b116-226e1fcf0402 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.386705 May 26 18:07:01.627472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 141/246] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:01 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:01.752177 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-b87daf2f-ffad-4d23-af3d-c01a3e36bcca req-1facd755-0fbd-4e65-966a-5e31674b4725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c10917-bf25-4d3c-990b-3c44c2b7847e", "tag": "d9b2d18d-b65f-4926-afd9-c098ee263dcf"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:01.784099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b87daf2f-ffad-4d23-af3d-c01a3e36bcca req-1facd755-0fbd-4e65-966a-5e31674b4725 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.784978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b87daf2f-ffad-4d23-af3d-c01a3e36bcca req-1facd755-0fbd-4e65-966a-5e31674b4725 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.804694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-b87daf2f-ffad-4d23-af3d-c01a3e36bcca req-1facd755-0fbd-4e65-966a-5e31674b4725 service nova] Creating event network-changed:d9b2d18d-b65f-4926-afd9-c098ee263dcf for instance 80c10917-bf25-4d3c-990b-3c44c2b7847e on hv-cinder-83906 May 26 18:07:01.811910 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-b87daf2f-ffad-4d23-af3d-c01a3e36bcca req-1facd755-0fbd-4e65-966a-5e31674b4725 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065979 May 26 18:07:01.813016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 142/247] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:02.067303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.089439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6428791a-3718-48ac-87ab-1bd564b209b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.684608 May 26 18:07:02.090048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 106/248] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:01 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:02.117932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:02.119049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:02.145344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.147085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.152354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.154532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.491401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.505449 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cf0816db-6661-46c9-ba44-5698d5aa8b12 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.392404 May 26 18:07:02.506391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 143/249] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:02 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:02.639843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:02.640478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:02.652738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.653194 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.653991 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.654546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.070807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.089491 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9d26c350-6775-4257-8882-b136cc623648 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.460050 May 26 18:07:03.090383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 107/250] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:02 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:03.116012 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.118396 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.152319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.153012 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.155618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.156581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.524179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.524997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.535245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.552733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d310e5d2-537c-4405-9503-5fa4a14576fe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.447048 May 26 18:07:03.567041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.569523 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 144/251] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:03.570668 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.574258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.575004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.111101 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:04.112968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:04.128646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.130606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.142928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.144387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.252303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:04.260412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b319db1a-af24-418d-b64b-2c7cae157ad1 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.740284 May 26 18:07:04.271422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 108/252] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:04.375745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:04.431441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:04.478784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:04.487288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4f04b4e8-1295-43b2-81ec-1354ce1aefd0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.383304 May 26 18:07:04.489022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 145/253] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:04 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:04.572064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:04.573185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:04.581383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.581829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.587799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.588511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.651881 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:05.104060 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.120216 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3a7944d8-3529-4a58-8c77-b6d1c61a58e8 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.551942 May 26 18:07:05.133237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 109/254] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:04 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:05.283429 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:05.285340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:05.306849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.309382 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.321584 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.322171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.640947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9872a1e8-a264-424b-95fc-e5e087297ef7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Action: 'create', calling method: .version_select at 0x7f1fa0650ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-17761177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlm3UbRsPY/ExlCQsl8Rw1zOXn0OStBt3OVbY+VRV3cLr/mI/rJdDJSwRaOkKhjBe+uI9NKzKMPg+OUPWqwcTt8merlUVtp/hAtKN9a5PjQhA+bk10bzq+O0uPiDdN8rg=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:05.647171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.657791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9872a1e8-a264-424b-95fc-e5e087297ef7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for project 45d94db7075c40cbae3f106a9661d969. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:05.658115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-87e02a40-61c4-473d-918a-2dafbc70626c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.380833 May 26 18:07:05.659279 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 146/255] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:05 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:05.663687 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9872a1e8-a264-424b-95fc-e5e087297ef7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for user 42c96a85400941818b658cca8cb56fec and project 45d94db7075c40cbae3f106a9661d969. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:05.664792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:05.665869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:05.673308 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.674031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.675103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.675896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.691224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9872a1e8-a264-424b-95fc-e5e087297ef7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.369238 May 26 18:07:05.696670 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 110/256] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:07:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:06.137087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.137302 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:06.137915 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:06.146259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.146733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.147566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.147971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.155915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ceaabc3-aa3f-412c-af14-474bdae0e10c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.494971 May 26 18:07:06.166798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 147/257] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:05 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:06.369419 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.381259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2360b1de-44f1-4c4d-b8a5-199a5b2eeb63 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.247181 May 26 18:07:06.383337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 111/258] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:06 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:06.682351 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:06.683475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:06.705139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.705883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.707944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.710111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.979377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.996146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1b448bf5-d5b3-43d3-a597-495aca54bd1b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.322797 May 26 18:07:06.997226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 148/259] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:06 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:07.174525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.176097 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.190055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.193067 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.197618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.198349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.400927 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.401557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.412193 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.414872 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.418221 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.418862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.557260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.570310 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e36175ae-1e0a-436d-b264-5a246465e70f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.397621 May 26 18:07:07.583984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 112/260] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:07 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:07.794549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.806298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33805b20-076f-4a50-8468-599ac48fe3e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.410481 May 26 18:07:07.808957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 149/261] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:07 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:08.027013 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.031336 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.063360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.063838 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.064636 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.065084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.564531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:08.598525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.599612 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.602411 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.604528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-61885332-3c24-42da-b3b7-668e91c4a8b8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.594872 May 26 18:07:08.608674 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 113/262] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:08.618535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.619435 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.620782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.621427 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.672293 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.833688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.834554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.856471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.860820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.861908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.862995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.117415 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:09.143493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-78866475-254f-4ec7-8ad8-f35de29b0ab4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.558846 May 26 18:07:09.145045 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 150/263] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:09.616196 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:09.627377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:09.628651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:09.637541 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9fa9d7bb-fec7-42f1-97ac-b36f239e49e0 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.808665 May 26 18:07:09.644330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 114/264] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:09.654450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.655655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.659299 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.664509 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.128241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.163243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:10.164167 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:10.169861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-edfbf205-9af5-49f8-9c7d-2cec9a8d9192 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.547471 May 26 18:07:10.171730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 151/265] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:09 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:10.190430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.193383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.195606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.203067 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.672542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.682697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:10.683743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:10.713138 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.714142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.715494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.716246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.720724 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ede85ee-9e70-4d44-8977-772caf389f0c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.553904 May 26 18:07:10.733127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 115/266] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:10 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:10.984703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.995869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-615662b7-122d-4cc5-aec3-a1e29a731d40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.320058 May 26 18:07:10.999846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 152/267] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:10 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:11.194073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:11.195296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:11.210145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.211314 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.213502 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.214870 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.577670 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:11.587935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e67f48f1-fe33-4709-9933-027e655c2dc9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.401174 May 26 18:07:11.588529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 116/268] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:11 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:11.739023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:11.739865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:11.747076 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.747714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.751363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.752131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:12.019220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:12.020672 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:12.048087 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:12.049839 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:12.054790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:12.055432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:12.227778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.241347 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1542f302-84ff-48a8-9c14-973239e554ba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.506335 May 26 18:07:12.246662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 153/269] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:11 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:12.389517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.447930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-931149f0-ecf8-4c03-bfb6-6d41c5c50ece tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.431632 May 26 18:07:12.454471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 117/270] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:12 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:12.606883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:12.607833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:12.618697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:12.619159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:12.620269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:12.620901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:12.881330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.893320 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e7b17ec-3db6-4458-9da7-bca9ecac763e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.291305 May 26 18:07:12.893924 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 154/271] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:12 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:13.264018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:13.264682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:13.275442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.275920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.276726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.277171 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.472958 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:13.474287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:13.502014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.503453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.505777 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.509378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.659657 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:13.670167 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a4afcf29-cfc9-4305-b719-1ba7fd34c614 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.409599 May 26 18:07:13.672103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 118/272] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:13 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:13.807066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:13.818126 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f10051e-4a3f-4aea-8923-cbb1d050361c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.351047 May 26 18:07:13.819376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 155/273] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:13 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:13.918547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:13.920058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:13.936799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.937426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.938529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.943088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.211007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:14.221040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5521b715-c517-454f-97d5-f4aca2cf6264 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.307659 May 26 18:07:14.231449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 119/274] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:13 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:14.690501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.691196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:14.698720 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.699274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.700234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.700689 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.838920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.840208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:14.864375 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.867016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.876234 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.882518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.885015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.080705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.098556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0dc2d820-c2ae-475a-85db-fe3b453fad7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.413544 May 26 18:07:15.099160 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 156/275] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:14 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:15.242785 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:15.244732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:15.259165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.261565 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.265588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.268518 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.537179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.549026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ead234ff-85ba-4ef2-a429-145be9b19071 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.313662 May 26 18:07:15.549896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 157/276] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:15 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:15.673577 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.694811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.708480 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c626f977-efae-4b1b-abeb-bd150198bd24 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.874784 May 26 18:07:15.709166 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 120/277] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:14 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:16.119601 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.120229 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:16.136385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.136842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.137694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.138139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.351918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:16.368866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-516fca22-3dc8-48f7-a5f9-23a2bcd30ce1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.253137 May 26 18:07:16.378159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 158/278] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:16 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:16.569094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.570867 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:16.579132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.579638 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.580547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.581041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.727567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.728470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:16.737093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.737880 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.738873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.739469 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.976642 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:17.005746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-89d550f0-2029-4d98-9319-80c80b36ca7a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.282083 May 26 18:07:17.017693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 159/279] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:16 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:17.034212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-01b5d035-55a1-40d7-a675-e7798d21e61e req-77b325dd-33a1-4c5a-a062-e9397f3cce19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c10917-bf25-4d3c-990b-3c44c2b7847e", "name": "network-vif-plugged", "status": "completed", "tag": "d9b2d18d-b65f-4926-afd9-c098ee263dcf"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:17.051705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-01b5d035-55a1-40d7-a675-e7798d21e61e req-77b325dd-33a1-4c5a-a062-e9397f3cce19 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.052013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-01b5d035-55a1-40d7-a675-e7798d21e61e req-77b325dd-33a1-4c5a-a062-e9397f3cce19 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.080936 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-01b5d035-55a1-40d7-a675-e7798d21e61e req-77b325dd-33a1-4c5a-a062-e9397f3cce19 service nova] Creating event network-vif-plugged:d9b2d18d-b65f-4926-afd9-c098ee263dcf for instance 80c10917-bf25-4d3c-990b-3c44c2b7847e on hv-cinder-83906 May 26 18:07:17.087738 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-01b5d035-55a1-40d7-a675-e7798d21e61e req-77b325dd-33a1-4c5a-a062-e9397f3cce19 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057405 May 26 18:07:17.089245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 160/280] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:17.090857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:17.100361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79eb990b-6ac4-43b0-b254-498d2851cc67 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.536972 May 26 18:07:17.100945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 121/281] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:16 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:17.410235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:17.410968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:17.421532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.422295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.423256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.423841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.789805 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:17.806175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-380ba205-8a3d-48de-95bf-f612ed6e24cb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.406705 May 26 18:07:17.819907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 161/282] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:17 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:18.023653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.024276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.035123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.035618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.036714 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.037347 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.121434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.124914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.166945 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.172618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.173832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.174329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.470256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.472197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.484808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-75224b3d-89f7-4bc3-a53a-dfa3e459084e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.465261 May 26 18:07:18.490337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 122/283] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:18.494856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27a2b5e1-1514-4f34-975b-046bb2659519 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.381311 May 26 18:07:18.496155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 162/284] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:18.830819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.831498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.849822 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.852976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.863450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.870386 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.512558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:19.513710 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.571818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.577380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.580479 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.582984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.974566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:19.977908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.993804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-03cb9f9d-6d75-427a-b12e-8064671840d9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 1.168109 May 26 18:07:19.995786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 123/285] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:20.022835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:20.023468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:20.050010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.054971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.056349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.058095 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.207060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.221538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4182ddac-f403-46af-a798-cfbc4fa15a50 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.715065 May 26 18:07:20.227127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 163/286] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:19 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:20.846707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.861260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5534d808-1b4a-4d62-86ae-f32bacb75766 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.862739 May 26 18:07:20.862074 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 124/287] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:19 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:21.024533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.025227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.041333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.045600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.046647 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.047124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.242837 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.244125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.272651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.285947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.287652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.291395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.467870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:21.484791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2bea3f35-9b13-4902-b460-49354a169697 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.466271 May 26 18:07:21.485549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 164/288] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:21.885667 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.886758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.913214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.914069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.916835 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.917587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.956501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:21.973054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9e589e19-a605-4e28-a674-ecdf7235ec33 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.726380 May 26 18:07:21.973450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 125/289] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:22.332342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:22.346950 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-004c3c25-2d9a-4464-b80a-dc3849316e9a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.468712 May 26 18:07:22.359034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 165/290] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:22.503492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:22.504125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:22.519844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.522586 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.523449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.523896 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.993533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:22.994309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:23.005934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.006490 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.007574 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.008247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.094070 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.109225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-356b122c-5677-4213-9c5a-d88ac54b427b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1368 microversion: 2.1 time: 0.609833 May 26 18:07:23.110421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 126/291] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:22 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1368 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:23.271744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.283588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2271bd6a-d0ce-4583-bdf9-184f41689849 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.294522 May 26 18:07:23.286814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 166/292] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:22 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:23.365762 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:23.366429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:23.394806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.395266 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.396064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.396508 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.692015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.699140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-363b6420-a1d5-4587-b006-d638b59c396c tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Action: 'create', calling method: .version_select at 0x7f1fa03c8430>, body: {"keypair": {"name": "tempest-TestShelveInstance-565443525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORck5yNr4ajrUOP0gRMy06zQfRWefRzvXy+Hi+xvzFK0UhjwTnLxYbKrY5GbeFVAmrmibvxv5LJcDcY3e2Piglgif3S68O0ooUTkBe4OPhGnJfnC9kUF8gdeV7PKlk/MA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:23.703012 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-58882b4a-d04d-411c-bc59-e8fa9dfd96ec tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.341124 May 26 18:07:23.704827 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 127/293] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:23 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:23.722615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-363b6420-a1d5-4587-b006-d638b59c396c tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Getting quotas for project c2cf8fb59b4f4b12900d336f1d91b1eb. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:23.730373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-363b6420-a1d5-4587-b006-d638b59c396c tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Getting quotas for user b2ba168683a4433f8a763cb4c250c9a0 and project c2cf8fb59b4f4b12900d336f1d91b1eb. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:23.771265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-363b6420-a1d5-4587-b006-d638b59c396c tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.402231 May 26 18:07:23.775882 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 167/294] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:07:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:24.132807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.133806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.159623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.159823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.160532 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.160989 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.318796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.319806 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.346476 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.347687 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.349069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.349575 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.390983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.564024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:24.591018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-82ba16b1-2c97-4ccb-bb21-16b494376841 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1559 microversion: 2.1 time: 0.464190 May 26 18:07:24.623228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 128/295] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1559 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:24.657280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.660207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.681479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.683050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.685607 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.688766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.912966 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9375e016-0b00-4d96-acce-552a2668bd43 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.284911 May 26 18:07:24.914038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 129/296] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/os-interface => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:24.920816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.921746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.941982 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.946076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.948854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.961540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.055494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.077825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff8856be-6548-4afd-9e79-21882b05509b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.761713 May 26 18:07:25.078533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 168/297] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:26.031787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:26.067442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7fff1f93-5be0-494c-89ff-7f3e0d4fb41e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1501 microversion: 2.1 time: 1.150306 May 26 18:07:26.069405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 130/298] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1501 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:26.095567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2924c0ca-8715-41d4-8446-ced1373c8964"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:26.096850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.113946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.115265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.115948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.117256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.142123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.143483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.171991 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.172769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.173600 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.174050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.253114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] HTTP exception thrown: Cannot 'attach_volume' instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 while it is in vm_state rescued May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Request method failure captured: May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/os-volume_attachments HTTP/1.1 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 74 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FP-eQmwCVvErdsoZ2kdT4qUsb86lF3Tz1lSgt3fZPaSuKQ5DbcnASrdG6Ld_I0wPlhDSwdF5Gc8u_HrJ_43tU9wFSPrsrQHa8WTSGhh4QwT894Nk4R5qJGRjKDFTwKwHYRkJx-NBt8Hdx_JQSmweFz7eHMXOgr58XUGkQbwOl5lOE May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:07:26.260680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 61f6dbd4328e459eb7d4f029551648bb May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "2924c0ca-8715-41d4-8446-ced1373c8964"}} May 26 18:07:26.262329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Cannot 'attach_volume' instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 while it is in vm_state rescued May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'b7e2e233-cbae-48e1-aa0e-cfc0231e18b3', 'body': {'volumeAttachment': {'volumeId': '2924c0ca-8715-41d4-8446-ced1373c8964'}}} May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:26.264079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 while it is in vm_state rescued May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:26.265377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 while it is in vm_state rescued May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Returning 409 to user: Cannot 'attach_volume' instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 while it is in vm_state rescued {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:26.267766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e03f748c-877a-4eaa-b94f-e21ce01d6d8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.179354 May 26 18:07:26.270129 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 169/299] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:07:26 2022] POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/os-volume_attachments => generated 152 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:07:26.288492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:26.289217 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.304391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.304874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.306026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.306508 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.495656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b1cc2e76-4885-4439-837b-e833bd38e339 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/action" status: 202 len: 0 microversion: 2.1 time: 0.224061 May 26 18:07:26.502789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 170/300] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:07:26 2022] POST /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:26.543401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.544154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.593950 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.594465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.595524 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.596162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.119464 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.166138 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1b6a9693-0d4d-42cf-ad90-575a8c1cc685 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1509 microversion: 2.1 time: 0.657147 May 26 18:07:27.184298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 171/301] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:26 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1509 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:27.858392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.871025 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe74e5f0-d2a1-4c7f-89a7-1cea6dec9b07 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 1.757029 May 26 18:07:27.872284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 131/302] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:26 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:28.203506 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:28.205131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:28.222801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.224150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.225634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.226595 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.513661 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:28.534866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-580191f5-8f34-4853-a698-16b2916d8b07 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1509 microversion: 2.1 time: 0.334810 May 26 18:07:28.534866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 172/303] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:28 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:28.895776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:28.896900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:28.911074 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.912182 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.921297 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.922522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.504406 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.515470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1a9e3923-cc6b-4a43-8500-88205f1214dd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.628953 May 26 18:07:29.516050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 132/304] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:28 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:29.549885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:29.550751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:29.562799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:29.563440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.564909 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:29.565891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.854040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.892765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a811a837-00f2-4da0-a81c-d746bbd07409 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1509 microversion: 2.1 time: 0.346638 May 26 18:07:29.893732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 173/305] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:29 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:30.250031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-47acf758-cabf-47c3-93ed-51b39011618c req-67067f71-08eb-47d4-a9f9-5095c612c541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c10917-bf25-4d3c-990b-3c44c2b7847e", "tag": "d9b2d18d-b65f-4926-afd9-c098ee263dcf"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:30.266923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-47acf758-cabf-47c3-93ed-51b39011618c req-67067f71-08eb-47d4-a9f9-5095c612c541 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.267487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-47acf758-cabf-47c3-93ed-51b39011618c req-67067f71-08eb-47d4-a9f9-5095c612c541 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.295713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-47acf758-cabf-47c3-93ed-51b39011618c req-67067f71-08eb-47d4-a9f9-5095c612c541 service nova] Creating event network-changed:d9b2d18d-b65f-4926-afd9-c098ee263dcf for instance 80c10917-bf25-4d3c-990b-3c44c2b7847e on hv-cinder-83906 May 26 18:07:30.303972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-47acf758-cabf-47c3-93ed-51b39011618c req-67067f71-08eb-47d4-a9f9-5095c612c541 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082726 May 26 18:07:30.305547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 133/306] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:30.547309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:30.547945 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:30.558170 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.559110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.561201 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.565079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.940349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:30.946215 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:30.976595 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.986451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.988528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.989824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:31.174906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.192285 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d938550-cfdf-4fab-b02c-8c0fb4ed01fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.649994 May 26 18:07:31.193668 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 174/307] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:30 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:31.448518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.460614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fd0dcacd-909b-43e1-aa8d-ac7c9e9ba087 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1509 microversion: 2.1 time: 0.535284 May 26 18:07:31.461848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 134/308] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:30 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:32.096231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-666383337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-17761177", "security_groups": [{"name": "tempest-secgroup-smoke-1733973357"}], "block_device_mapping_v2": [{"uuid": "f88acdd8-9bcc-4973-bc88-e8118ca40107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ba39add-f4a7-4061-91a5-b356a25c19cf"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:32.218362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:32.219764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:32.231042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.232198 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.234469 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.235781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.383541 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] validate_networks() for [('8ba39add-f4a7-4061-91a5-b356a25c19cf', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:07:32.611951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.629203 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3bc25282-9b13-4193-aa96-36df24f25fda tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.420839 May 26 18:07:32.630767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 135/309] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:32 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:32.647164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:32.648018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:32.660981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.661913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.663807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.664469 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.864310 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.873371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9bef925a-26c0-4c4e-b723-e75f2f7aa0f2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1515 microversion: 2.1 time: 0.241242 May 26 18:07:32.873993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 136/310] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:32 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:33.691024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:33.692196 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:33.742625 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.749778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.750655 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.752148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.755249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.022661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:34.061280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bda3389c-eecf-4dc5-ad4d-cbea8f546eff tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.412119 May 26 18:07:34.086374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 137/311] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:33 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:34.152874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:07:34.152874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:07:34.152874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:07:34.153322 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:07:34.154300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:07:34.165786 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.166633 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.167728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.168240 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.190762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:34.196212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for user 42c96a85400941818b658cca8cb56fec and project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:34.328635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:07:34.333425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f88acdd8-9bcc-4973-bc88-e8118ca40107',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:07:34.541506 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bce80665-6bd0-4bec-b6f3-a536158adc80 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.450520 May 26 18:07:34.543179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 175/312] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:07:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:07:34.562084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0b0a76b1-8abe-45ec-955d-24a4403d3ef0 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:34.563064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0b0a76b1-8abe-45ec-955d-24a4403d3ef0 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:34.683267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0b0a76b1-8abe-45ec-955d-24a4403d3ef0 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:34.696376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0b0a76b1-8abe-45ec-955d-24a4403d3ef0 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1092 microversion: 2.1 time: 0.139480 May 26 18:07:34.701449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 138/313] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:34 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1092 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:34.782286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e0368283-58e8-4b5e-9889-f5f387005b94 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: .version_select at 0x7f1fa03e5550>, body: {"keypair": {"name": "tempest-keypair-126842743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNK9OPrCJIDyuJeANU+nsHI0IkxKYRXJypzDgFW2SvE5rWNg0JvHkMG3xnGJFza8jcFc1f0L1V+fxXg+Glkb9IEb/4T7Bl3u/r610GMoGXuElb3HYIwPT4qcXsS7ygZ4Q=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:34.849005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e0368283-58e8-4b5e-9889-f5f387005b94 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:34.865668 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e0368283-58e8-4b5e-9889-f5f387005b94 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for user 61f6dbd4328e459eb7d4f029551648bb and project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:34.968432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e0368283-58e8-4b5e-9889-f5f387005b94 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191939 May 26 18:07:34.970331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 176/314] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:07:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:35.093033 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:35.093887 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:35.123811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.129856 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.134469 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.137129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.589156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:35.633197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4abb1cf4-de72-48ab-861f-3ab467f168f3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 0.545618 May 26 18:07:35.634928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 139/315] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:35 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:35.729769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:35.735432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:35.780197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.783970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.791105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.799224 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.514037 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:36.553446 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2bc42f3-7d99-4ce3-b797-9be44c72ef5f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1134 microversion: 2.1 time: 0.832602 May 26 18:07:36.556666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 177/316] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:35 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1134 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:36.655283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:36.657154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:36.691021 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.691492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.692404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.706361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.597045 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:37.603391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:37.636420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.653098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3ea6cc63-7e8b-4aa5-b9b9-57f52eff477a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1725 microversion: 2.1 time: 1.001416 May 26 18:07:37.658184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 140/317] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:36 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1725 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:37.700166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.704026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.705653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.710873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.930761 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.959010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41e301cf-5f6d-4076-ace8-6a7762fb48d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1208 microversion: 2.1 time: 0.372844 May 26 18:07:37.972615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 178/318] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:37 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1208 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:38.692912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:38.694426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:38.719305 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.719758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.720562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.721005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.868924 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-550491594", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "674e4916-1510-4fc4-b57b-b0089244acfe"}], "security_groups": [{"name": "tempest-securitygroup--1870960432"}], "key_name": "tempest-keypair-126842743", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:38.885040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.031396 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:39.051329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-11d3f5dd-b91e-4bd0-a0b7-f4c8f74cc479 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1702 microversion: 2.1 time: 0.366439 May 26 18:07:39.093004 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] validate_networks() for [('674e4916-1510-4fc4-b57b-b0089244acfe', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:07:39.096718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 141/319] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:38 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1702 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:39.105263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:39.108082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:39.117236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.119810 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.121088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.121954 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.171127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.977881 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.009044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9641d0d9-6d12-4e1c-b12c-6bd59714d5af tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.910508 May 26 18:07:40.011028 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 142/320] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:39 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:40.021521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e3665160-f561-44f1-9a66-700df4b20989 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:40.034028 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e3665160-f561-44f1-9a66-700df4b20989 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.035063 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e3665160-f561-44f1-9a66-700df4b20989 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.085878 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e3665160-f561-44f1-9a66-700df4b20989 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Going to try to start instance {{(pid=117833) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:07:40.127220 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:07:40.127891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:07:40.128134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:07:40.128620 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:07:40.134665 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:07:40.143523 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.146776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.150708 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.151173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.224517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:40.228319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e3665160-f561-44f1-9a66-700df4b20989 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action" status: 202 len: 0 microversion: 2.1 time: 0.214407 May 26 18:07:40.230403 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 143/321] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:07:40 2022] POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:40.245982 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Getting quotas for user 61f6dbd4328e459eb7d4f029551648bb and project 8c49a9a21f1346a0bc8d774afc7951a2. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:40.251222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:40.262749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:40.277879 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.288843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.292108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.293307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.300003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:07:40.302352 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:07:40.421047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f3ae4e70-5578-421b-ac6d-113d248e5dbb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.558287 May 26 18:07:40.439430 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 179/322] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:07:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:07:40.451714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da2cec96-d3c2-4caa-98f2-55ef4720dd3d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:40.452837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da2cec96-d3c2-4caa-98f2-55ef4720dd3d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:40.605391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da2cec96-d3c2-4caa-98f2-55ef4720dd3d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.629061 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da2cec96-d3c2-4caa-98f2-55ef4720dd3d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1244 microversion: 2.1 time: 0.182350 May 26 18:07:40.656870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 180/323] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:40 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1244 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:41.000172 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:41.009944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-91c3d732-7a11-4c56-8230-72777ee6c999 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1711 microversion: 2.1 time: 0.774011 May 26 18:07:41.010631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 144/324] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:40 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1711 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:41.033319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:41.033959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:41.047042 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.047539 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.051444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.052174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.470130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:41.485868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-261d0ec0-2636-4bee-b2b7-baadc26fcbd4 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.457867 May 26 18:07:41.487373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 181/325] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:41 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:41.664564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:41.665418 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:41.680313 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.681328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.688319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.689423 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.937237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:41.947603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f4b99ae-578d-4b82-bd7b-6faa003a0ffa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1296 microversion: 2.1 time: 0.286873 May 26 18:07:41.947843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 145/326] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:41 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1296 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:42.037472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:42.039065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:42.058131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.058988 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.061804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.071093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.368671 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-643651b1-bb0d-4970-af6c-df03be9414d8 req-5be6421e-2579-410a-bc1c-edf0ab96d683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f6bb73-a942-4dbe-9a48-e5260f4955af", "tag": "fd73efc2-2443-44e5-9d43-9649da06c136"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:42.370913 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:42.384196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d418a7a-a8c7-43d0-8d4f-46c61fcb09fb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1711 microversion: 2.1 time: 0.358463 May 26 18:07:42.400912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 182/327] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:42 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1711 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:42.401742 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-643651b1-bb0d-4970-af6c-df03be9414d8 req-5be6421e-2579-410a-bc1c-edf0ab96d683 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.402259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-643651b1-bb0d-4970-af6c-df03be9414d8 req-5be6421e-2579-410a-bc1c-edf0ab96d683 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.428634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-643651b1-bb0d-4970-af6c-df03be9414d8 req-5be6421e-2579-410a-bc1c-edf0ab96d683 service nova] Creating event network-changed:fd73efc2-2443-44e5-9d43-9649da06c136 for instance 68f6bb73-a942-4dbe-9a48-e5260f4955af on hv-cinder-83906 May 26 18:07:42.440545 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-643651b1-bb0d-4970-af6c-df03be9414d8 req-5be6421e-2579-410a-bc1c-edf0ab96d683 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101713 May 26 18:07:42.446645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 146/328] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:42.509401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:42.514620 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:42.535930 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.536664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.539593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.540400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.977225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:42.977937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:43.021682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.024109 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.032447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.033549 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.133958 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.144866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5909a27d-c43c-4678-ab40-8b784346ecf6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.643672 May 26 18:07:43.149716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 183/329] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:42 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:43.276156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.293132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1114432f-3045-4759-badd-4c5b65467b65 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1302 microversion: 2.1 time: 0.320817 May 26 18:07:43.293820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 147/330] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:42 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1302 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:43.406705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:43.407833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:43.417531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.420244 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.422091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.423572 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.648826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.671405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83d3d556-75e4-4b87-9a9e-1f7b293d31ed tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1711 microversion: 2.1 time: 0.271610 May 26 18:07:43.674999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 184/331] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:43 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1711 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:44.171452 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:44.173034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:44.188591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.189367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.190736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.191495 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.312538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:44.313436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:44.328470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.328941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.329990 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.330868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.451175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:44.476033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dea2b596-b9bd-48f6-84fb-10ec062789b0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1302 microversion: 2.1 time: 0.163613 May 26 18:07:44.478370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 185/332] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:44 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1302 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:44.556445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:44.570851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f3eebfab-7d5c-4bba-90ca-9337ed64a5dd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.404635 May 26 18:07:44.592311 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 148/333] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:44 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:44.702538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:44.705310 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:44.719890 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.723653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.724637 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.725234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.054607 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.069118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff78b090-6f09-40d7-bb5f-be34d05f10e6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1715 microversion: 2.1 time: 0.371355 May 26 18:07:45.070748 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 186/334] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:44 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1715 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:45.501853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:45.505049 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:45.536320 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.538243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=60 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.541647 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.546487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.549777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.555817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.596816 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:45.598105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:45.626345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.637597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.639408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.640128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.068231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.071684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.086601 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bf040a92-b004-4179-8f8e-43e8bc02a099 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.494150 May 26 18:07:46.101273 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 187/335] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:45 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:46.136795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.145992 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f55da43-e6f6-4084-8b9c-5da1a1452916 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.654256 May 26 18:07:46.154091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 149/336] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:45 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:46.302166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1389218087", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-565443525", "security_groups": [{"name": "tempest-secgroup-smoke-314225202"}], "networks": [{"uuid": "5ff450f3-5a0c-4191-a23a-7524e2ee2ff8"}], "block_device_mapping_v2": [{"uuid": "f29fe830-1fc2-44cf-a760-c4dc3afca418", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:46.510683 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] validate_networks() for [('5ff450f3-5a0c-4191-a23a-7524e2ee2ff8', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:07:46.981971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-07a0a4a0-a7ab-4397-a602-0e5acb809cce req-d5d73f9a-5d75-480c-b993-850171551c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:47.035993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-07a0a4a0-a7ab-4397-a602-0e5acb809cce req-d5d73f9a-5d75-480c-b993-850171551c4c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.038101 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-07a0a4a0-a7ab-4397-a602-0e5acb809cce req-d5d73f9a-5d75-480c-b993-850171551c4c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.083851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-07a0a4a0-a7ab-4397-a602-0e5acb809cce req-d5d73f9a-5d75-480c-b993-850171551c4c service nova] Creating event network-changed:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:07:47.100694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-07a0a4a0-a7ab-4397-a602-0e5acb809cce req-d5d73f9a-5d75-480c-b993-850171551c4c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124788 May 26 18:07:47.104430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 150/337] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:47.118792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:47.126921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:47.145036 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.148886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.151721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.155749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.569591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:07:47.572267 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:07:47.573820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:07:47.579857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:07:47.581993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:07:47.637903 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.639447 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.651690 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.652986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.699932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Getting quotas for project c2cf8fb59b4f4b12900d336f1d91b1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:47.709321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Getting quotas for user b2ba168683a4433f8a763cb4c250c9a0 and project c2cf8fb59b4f4b12900d336f1d91b1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:47.827776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:47.872606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a8b30226-088a-4251-b5ed-b13feeaf7c5c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.764355 May 26 18:07:47.874686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 151/338] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:47 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:47.888482 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:47.890454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:47.914502 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.916327 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.921054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.922412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.980422 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:07:48.001377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f29fe830-1fc2-44cf-a760-c4dc3afca418',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:07:48.319581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:48.331999 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-232aa91c-f8c4-4951-97d3-da6326d3a990 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.452973 May 26 18:07:48.332962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 152/339] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:47 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:48.428748 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e787589-d1da-4870-9b2e-679ea198257d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.128964 May 26 18:07:48.430624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 188/340] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:07:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:07:48.444980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-869a010c-2843-4a1e-9a2f-684b5a27c6c8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.444980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-869a010c-2843-4a1e-9a2f-684b5a27c6c8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.570890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-869a010c-2843-4a1e-9a2f-684b5a27c6c8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:48.590555 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-869a010c-2843-4a1e-9a2f-684b5a27c6c8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1088 microversion: 2.1 time: 0.151818 May 26 18:07:48.605975 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 153/341] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1088 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:48.895034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.897185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.912071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.913512 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.915295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.916293 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.138461 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.155771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-89209c77-debe-414d-a850-c97b417c2aad tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.265846 May 26 18:07:49.156690 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 189/342] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:49.362763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:49.363557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:49.373166 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.374549 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.377318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.378080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.557280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.569170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6a59434-8c11-4408-b649-5558b5af01ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.210995 May 26 18:07:49.570398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 154/343] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:49 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:49.613017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:49.614228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:49.632479 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.634726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.636481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.637415 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.754794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.770559 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eb9ef458-6d79-4c5b-a1a0-abd03cdf1419 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1138 microversion: 2.1 time: 0.164587 May 26 18:07:49.771643 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 190/344] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:49 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1138 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:50.179934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:50.185873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:50.211433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.217092 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.219888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.221142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.598888 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:50.600217 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:50.608287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.609054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.610056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.610683 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.617909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.634317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5784cf6a-0336-4265-a8e5-de261e2df91c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.461828 May 26 18:07:50.635651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 155/345] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:50 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:50.793628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:50.796817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:50.814766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.820454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.826572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.827812 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.862065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.883249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-203d7f25-11d0-44d6-8e0b-b6c296b94999 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.287886 May 26 18:07:50.884865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 191/346] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:50 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:50.974597 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.990679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7d1334bf-9968-4a5b-99f9-0cca5dba0d33 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.204446 May 26 18:07:50.993656 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 156/347] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:50 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:51.651994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.653617 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.667072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.667594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.669766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.670082 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.911171 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.916918 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.931962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.938226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.938226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.938226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.942159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:51.956600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c34396eb-ceca-4559-87d3-5657b1dc13ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.308091 May 26 18:07:51.966329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 192/348] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:51 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:52.022035 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:52.022733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:52.052217 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:52.052678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:52.053488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:52.053985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:52.174503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:52.191043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8c67fcce-d5cd-44fd-a369-a46820574538 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.183370 May 26 18:07:52.200571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 193/349] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:52 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:52.268569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:52.282052 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77b81a6c-ce82-4f7c-abb5-29ba1ac50a0e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.383780 May 26 18:07:52.282872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 157/350] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:51 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:52.984166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:52.985470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:52.998788 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:52.999536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.000499 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.001102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.213450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:53.214355 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:53.229954 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.230836 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.241268 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.242180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.256048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.268970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8cb3075f-f253-4c3a-86a3-0084e9adb15c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.289394 May 26 18:07:53.281019 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 194/351] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:52 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:53.308998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:53.310226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:53.322434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.323419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.324282 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.324731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.357795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.378406 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6d3f7243-c8e9-40bf-8012-7e0588ab9c71 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.172771 May 26 18:07:53.392246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 158/352] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:53 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:53.535877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.552694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-42ed1160-8246-47d3-8313-95b7fbcffafa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.247567 May 26 18:07:53.553721 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 195/353] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:53 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:54.288306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.289959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.317857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.318621 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.319578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.320169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.404830 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.405874 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.433007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.433666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.443329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.443329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.585510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.602496 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6470a443-5c42-4043-92f2-8f30181bbed1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.318297 May 26 18:07:54.620193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 159/354] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:54.633842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.635669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.647863 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.662835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.664338 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6960abdf-a0db-467f-81a6-057ca157950d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.267960 May 26 18:07:54.678234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 196/355] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:54.678924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.678924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.678924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.686776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-64a07445-27aa-4147-a4c9-55d2c713d4cf req-48464eba-d92f-4e6a-b556-7361a79c9ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "name": "network-vif-plugged", "status": "completed", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:54.701339 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-64a07445-27aa-4147-a4c9-55d2c713d4cf req-48464eba-d92f-4e6a-b556-7361a79c9ab4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.702081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-64a07445-27aa-4147-a4c9-55d2c713d4cf req-48464eba-d92f-4e6a-b556-7361a79c9ab4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.717189 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-64a07445-27aa-4147-a4c9-55d2c713d4cf req-48464eba-d92f-4e6a-b556-7361a79c9ab4 service nova] Creating event network-vif-plugged:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:07:54.718356 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.726397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-64a07445-27aa-4147-a4c9-55d2c713d4cf req-48464eba-d92f-4e6a-b556-7361a79c9ab4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044448 May 26 18:07:54.727814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 197/356] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:54.925904 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.938082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c1b92dc0-a403-4a24-b002-90c915f11678 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.313444 May 26 18:07:54.938790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 160/357] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:55.637294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.638701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.646531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.647052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.647779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.648228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.696917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.697538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.710605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.711386 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.712390 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.713024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.814402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:55.828523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-97b530df-8464-4fe0-b84e-001dc8a3719f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.137073 May 26 18:07:55.829769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 161/358] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:55 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:55.858706 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:55.866919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0978b380-8dd0-4a5a-9d1f-a212e7c5ce75 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.234451 May 26 18:07:55.867526 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 198/359] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:55 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:55.956228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.956887 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.963487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.964367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.964876 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.965295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.120867 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.132142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8b0b35d4-7fc7-40a7-98be-ed1425e6145a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.179635 May 26 18:07:56.133350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 162/360] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:55 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:56.242677 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec09049e-9100-4a7b-8d37-a2eb9e79cf62 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'create', calling method: .version_select at 0x7f1fa0460f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-971143219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtJRuafc4QFQsKI9sC4w/v2HwrOlbcZ1UvYSdriG4EHiv9Ip31vqDcKMgi7yxqLfJnz7S+31XGyuAz76lrGvlbmYQ30fD6GVREIFswgfJVbFB2516s0HTXMlS2RTD5iwQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:56.258154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ec09049e-9100-4a7b-8d37-a2eb9e79cf62 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Getting quotas for project 98761773ea78490baebe0b3d9414ac45. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:56.262428 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ec09049e-9100-4a7b-8d37-a2eb9e79cf62 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Getting quotas for user c02d672b8b864940a57d9954fa44c6b2 and project 98761773ea78490baebe0b3d9414ac45. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:56.302471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec09049e-9100-4a7b-8d37-a2eb9e79cf62 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063861 May 26 18:07:56.303799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 199/361] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:07:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:56.367655 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-124139455", "imageRef": "ecec2717-6c45-4970-84d7-9b1bbbde3053", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-971143219", "networks": [{"uuid": "9fcc67dc-f23b-473a-b2d1-b02ae2b2a272"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:56.432080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] validate_networks() for [('9fcc67dc-f23b-473a-b2d1-b02ae2b2a272', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:07:56.846537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:56.847101 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:56.853525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.854031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.854837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.855283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.930534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.939103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a45d5ae-c618-407b-8c52-e062bf2b3dd1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1186 microversion: 2.1 time: 0.097229 May 26 18:07:56.940051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 200/362] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:56 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:56.944704 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:56.945319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:56.953360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.953857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.954682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.955163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.184031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:07:57.184835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:07:57.185217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:07:57.185665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:07:57.186107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:07:57.200434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.200997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.202734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.203190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.206357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.215383 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e2a085b-2db9-4899-9324-c28a02455ba6 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.274502 May 26 18:07:57.216020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 201/363] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:56 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:57.220951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:57.221718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Getting quotas for project 98761773ea78490baebe0b3d9414ac45. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:57.222025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:57.226400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Getting quotas for user c02d672b8b864940a57d9954fa44c6b2 and project 98761773ea78490baebe0b3d9414ac45. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:57.228788 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.229246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.230038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.230527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.239538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:07:57.241783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecec2717-6c45-4970-84d7-9b1bbbde3053',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:07:57.291391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [a4f1f2e7-861c-4f5d-a023-ab78022ffbbd] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:07:57.666907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.674372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.677270 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1485f9dd-1ab0-4835-aab1-95434ab39572 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1370 microversion: 2.1 time: 0.460016 May 26 18:07:57.677884 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 202/364] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:57 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:57.955466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:57.956125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:57.963328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.963781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.964561 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.965003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.039876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.049258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a8e2ee95-830d-43fe-9a04-9c808c2103ee tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1204 microversion: 2.1 time: 0.097739 May 26 18:07:58.049850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 203/365] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:57 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:58.233368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.233998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.240501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.241080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.241963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.242529 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.301631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [a4f1f2e7-861c-4f5d-a023-ab78022ffbbd] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 36584. May 26 18:07:58.308907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e46d2d30-7e61-4259-9e9f-c9e4d4b4560f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949332 May 26 18:07:58.310955 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 163/366] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:07:58.323392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3d5e1d4c-6bef-4141-8415-7a1b1f0bc653 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.324397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3d5e1d4c-6bef-4141-8415-7a1b1f0bc653 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.419530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3d5e1d4c-6bef-4141-8415-7a1b1f0bc653 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.431905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3d5e1d4c-6bef-4141-8415-7a1b1f0bc653 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1257 microversion: 2.1 time: 0.114381 May 26 18:07:58.433106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 164/367] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1257 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:58.509818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.524388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6965a312-68a2-49aa-bda0-90eee1613382 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.295738 May 26 18:07:58.525259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 204/368] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:58.705300 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.705932 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.728033 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.729290 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.730395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.730845 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.938056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.952945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-882f9fca-0b62-486a-b097-628023d35a6e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1565 microversion: 2.1 time: 0.259228 May 26 18:07:58.960336 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 165/369] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:58.970487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.971873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.979298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.980525 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.982271 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.983051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.071334 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:59.072511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.078757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a5661437-ce4e-4715-b70e-25f9fdc7c53d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112330 May 26 18:07:59.084846 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.085739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.085904 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 205/370] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:59.087209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.088006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.454977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:59.456509 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.469429 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.470631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.473154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.474234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.479677 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:59.505864 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8f5f3e1-6e50-4b4f-8820-c143629763d6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1271 microversion: 2.1 time: 0.437067 May 26 18:07:59.517600 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 166/371] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:59 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1271 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:59.547221 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:59.550259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.574998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.577144 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.578885 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.580230 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.729500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:59.739782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-752119a4-0405-48cf-b6ba-962d06263b92 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1253 microversion: 2.1 time: 0.292802 May 26 18:07:59.741685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 206/372] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:59 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1253 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:59.956649 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:59.977466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-10025d09-80a4-4399-9b28-860e5631dd8a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.432026 May 26 18:07:59.978581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 167/373] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:07:59 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:00.167649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-2bda9009-9a0a-4190-99f8-5ae1637d971f req-91eb1fef-b523-44f6-bd8e-73db37e0f362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:00.188988 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:00.194905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2bda9009-9a0a-4190-99f8-5ae1637d971f req-91eb1fef-b523-44f6-bd8e-73db37e0f362 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.204033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2bda9009-9a0a-4190-99f8-5ae1637d971f req-91eb1fef-b523-44f6-bd8e-73db37e0f362 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.208182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:00.244003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-2bda9009-9a0a-4190-99f8-5ae1637d971f req-91eb1fef-b523-44f6-bd8e-73db37e0f362 service nova] Creating event network-changed:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:08:00.250582 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-2bda9009-9a0a-4190-99f8-5ae1637d971f req-91eb1fef-b523-44f6-bd8e-73db37e0f362 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090673 May 26 18:08:00.255374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 207/374] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:00.526872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:00.527783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:00.536179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.536950 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.539375 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.540670 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.762250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:00.762250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:00.779767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.781113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.782505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.787167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.897884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.919601 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e7566ca6-38c0-4712-956e-fdd8da22937a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.397110 May 26 18:08:00.921420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 168/375] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:00 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:00.926437 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ce0547f6-ad5c-4151-933a-65c6010cc1ea req-0d511103-50ce-4556-a7ac-74bb1c945e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:00.938858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ce0547f6-ad5c-4151-933a-65c6010cc1ea req-0d511103-50ce-4556-a7ac-74bb1c945e2b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.939630 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ce0547f6-ad5c-4151-933a-65c6010cc1ea req-0d511103-50ce-4556-a7ac-74bb1c945e2b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.964566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ce0547f6-ad5c-4151-933a-65c6010cc1ea req-0d511103-50ce-4556-a7ac-74bb1c945e2b service nova] Creating event network-changed:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:08:00.982142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.991215 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ce0547f6-ad5c-4151-933a-65c6010cc1ea req-0d511103-50ce-4556-a7ac-74bb1c945e2b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068118 May 26 18:08:00.994160 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5694ed91-e795-4d7e-bb75-181ac2bd0a55 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1315 microversion: 2.1 time: 0.237166 May 26 18:08:00.995177 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 169/376] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:01.006237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 208/377] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:00 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:01.008096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:01.009189 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:01.042933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.043412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.050786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.050786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.063354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-bda3f086-d62e-4957-ba3e-f19f81e5206c req-61b427bb-df16-4b4c-89e7-e94c056e4283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6bb73-a942-4dbe-9a48-e5260f4955af", "name": "network-vif-plugged", "status": "completed", "tag": "fd73efc2-2443-44e5-9d43-9649da06c136"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:01.072489 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bda3f086-d62e-4957-ba3e-f19f81e5206c req-61b427bb-df16-4b4c-89e7-e94c056e4283 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.072929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bda3f086-d62e-4957-ba3e-f19f81e5206c req-61b427bb-df16-4b4c-89e7-e94c056e4283 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.155720 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-bda3f086-d62e-4957-ba3e-f19f81e5206c req-61b427bb-df16-4b4c-89e7-e94c056e4283 service nova] Creating event network-vif-plugged:fd73efc2-2443-44e5-9d43-9649da06c136 for instance 68f6bb73-a942-4dbe-9a48-e5260f4955af on hv-cinder-83906 May 26 18:08:01.167678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-bda3f086-d62e-4957-ba3e-f19f81e5206c req-61b427bb-df16-4b4c-89e7-e94c056e4283 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114465 May 26 18:08:01.169911 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 209/378] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 26 18:08:01.534450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:01.549289 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2862ea4-0d97-4086-af63-2fe0d888946e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.548816 May 26 18:08:01.550217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 170/379] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:00 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:01.958451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:01.959182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:01.974612 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.975069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.975884 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.976323 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:02.030907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:02.031554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:02.057211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:02.057768 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:02.058812 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:02.068863 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:02.318964 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:02.340407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27a43729-b8d0-4cec-b0aa-5654797a7cb6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.403777 May 26 18:08:02.342034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 210/380] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:01 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:02.481601 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:02.491199 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41812ed0-d8db-4fb0-91f2-16edd36d3b49 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.465512 May 26 18:08:02.492454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 171/381] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:02 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:02.571724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:02.572404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:02.580440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:02.580946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:02.581783 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:02.582269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:02.798809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:02.808012 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-38e2324a-6436-4cd8-b8d7-1ea34fd24615 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.243268 May 26 18:08:02.809838 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 211/382] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:02 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:03.360641 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:03.361238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:03.372907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.374830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.379658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.380402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.518694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:03.519989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:03.530280 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.530953 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.531895 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.532414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.634401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:03.651816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5e0452da-34f7-486b-8871-69861d6bd2f8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.295499 May 26 18:08:03.652439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 172/383] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:03 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:03.730714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:03.739790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59e9f132-1528-4661-9756-6e0a97f69bf5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.234191 May 26 18:08:03.740382 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 212/384] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:03 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:03.832424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:03.833676 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:03.845323 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.846512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.848171 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.848915 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.134809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.139788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9aa3f312-d9a8-4ed2-8198-e1c62f15ac20 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.315090 May 26 18:08:04.140859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 173/385] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:03 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:04.671981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:04.673158 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:04.684892 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.685820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.687156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.687935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.757391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:04.758227 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:04.766974 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.767740 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.768852 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.769455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.885950 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.897919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a49fc792-d330-4872-bbe6-dbaa71ae25fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.231377 May 26 18:08:04.899500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 213/386] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:04 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:04.971546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.979298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c30eeda3-98e3-45e4-890c-7ad1377461c5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.225781 May 26 18:08:04.979959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 174/387] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:04 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:05.167856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:05.168507 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:05.179784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.180583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.181919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.182698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.358091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:05.366344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d3d945f-8456-49db-b4ab-5fab0ae8d59c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.203732 May 26 18:08:05.366942 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 214/388] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:05 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:05.920402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:05.921039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:05.927948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.928397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.929176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.929612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.998686 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:05.999465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:06.020288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.020811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.021649 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.022110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.130784 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:06.153716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-45c5b8b8-3051-4a9c-8fa4-de7ed8955add tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.239207 May 26 18:08:06.164296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 175/389] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:05 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:06.190543 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:06.198412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81e4c97c-869e-4426-8d1d-b85712aea1db tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.205125 May 26 18:08:06.198996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 215/390] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:05 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:06.396387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:06.397597 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:06.414168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.415168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.416976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.417772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.605162 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:06.614032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cdedfbd7-7dcb-4b69-b6e6-4983f41473f9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.224842 May 26 18:08:06.614644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 176/391] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:06 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.178609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:07.180178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:07.182523 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=28 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.189301 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.191743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.191743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.191743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.218126 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:07.219205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:07.221947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.245048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.245048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.245048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.245048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.382217 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.396335 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d5d7ee28-61bb-4460-862b-35f6f800967f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.224962 May 26 18:08:07.406463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 216/392] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:07 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.466783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.474604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a10ff23c-bceb-45db-ab0b-77bd4f7809e2 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.261127 May 26 18:08:07.475186 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 177/393] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:07 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.635912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:07.638222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:07.651805 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.652666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.654993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:07.655780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.843499 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.851444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a67f75af-5cad-4e61-830c-542f827a850d tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.224207 May 26 18:08:07.852034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 217/394] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:07 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:08.414718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:08.415722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:08.422911 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.423374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.424226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.424656 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.428100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=10 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.496548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:08.498028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:08.505967 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.506646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.507588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.508136 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.643373 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:08.661475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-82c31b8d-d2b3-4b67-8931-90caf4c61017 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.250791 May 26 18:08:08.671646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 178/395] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:08 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:08.704439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:08.712249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1139235f-79d1-481e-aab4-cb304603425f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.220072 May 26 18:08:08.712848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 218/396] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:08 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:08.869870 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:08.870633 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:08.880603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.880603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.880603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.880603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.896169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.075385 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.088790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2b25327-9f79-42fb-b22b-693db5ee0547 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.222264 May 26 18:08:09.089880 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 179/397] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:08 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:09.685254 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:09.686366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:09.698389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.699261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.701424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.702258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.732748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:09.734309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:09.741405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.741852 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.742691 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.743129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.940660 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.951167 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-087784af-ec3b-43ef-806c-ed75c8b87fbc tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.223483 May 26 18:08:09.955327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.961037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 180/398] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:09 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:09.974097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-42b0afe5-27c1-4ae0-9473-477e633b661b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.296108 May 26 18:08:09.976242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 219/399] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:09 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:10.114223 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:10.115366 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:10.123511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.124367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:10.125832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.126667 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:10.302756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:10.311460 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-985db518-1ba7-423a-b95a-1f7439a54147 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.201537 May 26 18:08:10.312071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 181/400] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:10 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:10.977752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:10.979292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:10.987744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.988216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:10.989581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.989581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.001610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:11.003174 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:11.011324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:11.011845 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.013793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:11.014333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.177209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.189079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b2a181d-4d26-4847-9943-e16cab2dad83 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.214804 May 26 18:08:11.190169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 220/401] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:10 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:11.333231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:11.334497 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:11.345928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:11.346870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.348378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:11.349305 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.406867 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.419202 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8dd81203-8fb5-47ee-855d-df2524d5eea4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.422579 May 26 18:08:11.425024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 182/402] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:10 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:11.608253 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.629370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52fe1f9c-c949-4527-a17d-9a593a04d494 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.303894 May 26 18:08:11.630841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 221/403] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:11 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:12.209187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:12.210555 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:12.218730 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.219197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.220055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.220731 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.442148 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:12.443215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:12.451997 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.452624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.453670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.454333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.634405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.635803 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.644611 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a3bafc5-9a0e-4886-b6e0-634450cf01e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.439269 May 26 18:08:12.645500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 183/404] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:12 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:12.651802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8b12a6b4-28a0-43ba-b74d-2a63a5364443 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.214224 May 26 18:08:12.657250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:12.658050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:12.662862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 222/405] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:12 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:12.666224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.667518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.667518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.668047 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.826378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-30466c9b-8b86-41df-bfcd-7eb96cef8e73 req-83d2cbab-92f1-44e1-a149-1351c23d7d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:12.840976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-30466c9b-8b86-41df-bfcd-7eb96cef8e73 req-83d2cbab-92f1-44e1-a149-1351c23d7d20 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.840976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-30466c9b-8b86-41df-bfcd-7eb96cef8e73 req-83d2cbab-92f1-44e1-a149-1351c23d7d20 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.860907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-30466c9b-8b86-41df-bfcd-7eb96cef8e73 req-83d2cbab-92f1-44e1-a149-1351c23d7d20 service nova] Creating event network-changed:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:08:12.866760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-30466c9b-8b86-41df-bfcd-7eb96cef8e73 req-83d2cbab-92f1-44e1-a149-1351c23d7d20 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049237 May 26 18:08:12.867379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 223/406] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:12.913693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.928660 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c106ec69-97a1-4034-a338-0ad05ea7b284 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.275675 May 26 18:08:12.929764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 184/407] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:12 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:13.673150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:13.673781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:13.677482 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:13.678381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:13.681406 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.681862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.682679 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.683115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.687648 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.688128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.688909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.689352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.850031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:13.860128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ddba4471-f0a0-4fb1-b5ea-e08facf4cf0e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.188124 May 26 18:08:13.860898 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 185/408] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:13 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:13.882705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:13.891154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc55abba-e1bb-4e02-be8f-f2f8f356562a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.223299 May 26 18:08:13.891750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 224/409] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:13 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:13.951498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:13.953148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:13.964984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.966333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.968242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.969099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:14.163617 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:14.179497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe5fb23c-b7ab-47e1-a037-89d916e9e915 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1264 microversion: 2.1 time: 0.235025 May 26 18:08:14.180563 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 186/410] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:13 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:14.877824 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:14.878374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:14.884903 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:14.885361 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:14.886129 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:14.886599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:14.916554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:14.917175 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:14.924153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:14.924604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:14.925381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:14.925820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.023302 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.025632 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.032818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-636b6995-f47c-4110-8e9a-628627fabd98 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.158864 May 26 18:08:15.033417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 225/411] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:14 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:15.060007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.067610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8e4bd55c-707c-4670-b4f0-304f44b6eb11 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.154824 May 26 18:08:15.068192 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 187/412] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:14 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:15.199878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.200573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:15.207050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.207514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.208294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.208735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.347115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.354746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d4faaa4-d444-4e10-ba9e-5a2918f5c6f7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1451 microversion: 2.1 time: 0.159510 May 26 18:08:15.355318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 226/413] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:15.371946 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.372573 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:15.378986 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.379440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.380224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.380664 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.532307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.540124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d5d76351-2508-41b2-9079-aee70436d944 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1451 microversion: 2.1 time: 0.172085 May 26 18:08:15.540702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 188/414] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:16.050416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.051118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.057605 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.058055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.059792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.060249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.084544 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.085811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.089478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.094470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.094932 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.095714 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.096159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.231365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:16.239300 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a200ee65-5766-4f31-a59e-25fcc2998367 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.158524 May 26 18:08:16.240002 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 189/415] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:16 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:16.302957 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:16.311420 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f6a395a-1830-40f7-aaa9-221501429c50 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.265075 May 26 18:08:16.312025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 227/416] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:16 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:16.739363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.739893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.746342 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.747443 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.748154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.748585 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.773440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-401283f1-b669-4750-98ee-cad9eed7fe1f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/ips" status: 200 len: 150 microversion: 2.1 time: 0.037984 May 26 18:08:16.774025 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 190/417] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:08:16 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:16.785155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ac5aa0-9184-4099-a806-dc70d2bba06a"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:16.786443 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.793078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.794185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.795214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.795679 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.881294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/os-volume_attachments HTTP/1.1 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 74 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:08:16.883044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "49ac5aa0-9184-4099-a806-dc70d2bba06a"}} May 26 18:08:16.884669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'server_id': '80c10917-bf25-4d3c-990b-3c44c2b7847e', 'body': {'volumeAttachment': {'volumeId': '49ac5aa0-9184-4099-a806-dc70d2bba06a'}}} May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:16.889156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:16.890732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 400 to user: Invalid volume: volume 49ac5aa0-9184-4099-a806-dc70d2bba06a is already attached to instances: 9288cf08-2b09-4c42-9831-8fbaa8f789ca {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e6df707-7274-42ca-8a9f-bf0eb4e71900 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103862 May 26 18:08:16.892161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 228/418] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:08:16 2022] POST /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:08:16.894368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.894874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.901199 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.901648 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.902456 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.903453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.929923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:17.007162 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-389cbac5-ccdb-4c68-8784-1a7424d73a08 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 204 len: 0 microversion: 2.1 time: 0.116768 May 26 18:08:17.007754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 191/419] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:08:16 2022] DELETE /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:08:17.015898 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:17.016500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:17.023214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.023673 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.024445 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.024886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.214568 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.222920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-19a41bf5-20da-4a02-b261-6faf70b12625 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1683 microversion: 2.1 time: 0.210910 May 26 18:08:17.223596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 229/420] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:17 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:17.257980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:17.259481 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:17.267042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.267499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.268271 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.268721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.329045 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:17.329811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:17.336176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.336784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.337629 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.338141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.414609 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.422569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-584c55eb-5657-400d-9bb7-bcc18ee2577a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.169395 May 26 18:08:17.423154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 192/421] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:17 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:17.556778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.565106 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99ca84da-e550-4f51-aa49-689ac91bc5b0 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.240525 May 26 18:08:17.565691 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 230/422] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:17 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:17.834801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-74901425-bf0e-4358-9088-0a8d864d9d6a req-39c5bacb-605b-44a5-9dfb-f57ae186696e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f6bb73-a942-4dbe-9a48-e5260f4955af", "tag": "fd73efc2-2443-44e5-9d43-9649da06c136"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:17.843651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-74901425-bf0e-4358-9088-0a8d864d9d6a req-39c5bacb-605b-44a5-9dfb-f57ae186696e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.844104 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-74901425-bf0e-4358-9088-0a8d864d9d6a req-39c5bacb-605b-44a5-9dfb-f57ae186696e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.856107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-74901425-bf0e-4358-9088-0a8d864d9d6a req-39c5bacb-605b-44a5-9dfb-f57ae186696e service nova] Creating event network-changed:fd73efc2-2443-44e5-9d43-9649da06c136 for instance 68f6bb73-a942-4dbe-9a48-e5260f4955af on hv-cinder-83906 May 26 18:08:17.861170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-74901425-bf0e-4358-9088-0a8d864d9d6a req-39c5bacb-605b-44a5-9dfb-f57ae186696e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 May 26 18:08:17.861816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 193/423] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:18.242641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:18.243297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:18.250852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.251287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.252063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.252519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.406175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.416687 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a3850d6-04a4-4e00-b8e9-322ead8f3872 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1683 microversion: 2.1 time: 0.177895 May 26 18:08:18.417307 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 231/424] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:18 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:18.439963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:18.440676 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:18.447298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.447755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.448544 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.448983 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.582216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:18.582841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:18.589188 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.589905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.591909 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.592395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.598468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.607700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6dfd3f92-0cbd-427d-a9d7-fb0c7e4059bb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.172273 May 26 18:08:18.608524 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 194/425] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:18 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:18.744538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.760028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-94356c1a-31b6-430c-bf0f-195bc72da247 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.181552 May 26 18:08:18.776159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 232/426] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:18 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:19.436394 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:19.436923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:19.443453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.444098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.444658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.445102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.460584 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.578493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.586846 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-39a7cc24-8632-4b6e-aeb4-1f3492ef5454 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1683 microversion: 2.1 time: 0.154930 May 26 18:08:19.588151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 195/427] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:19 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:19.625466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:19.626092 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:19.633015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.633475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.634287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.634938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.783725 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:19.784351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:19.790393 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.790848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.791620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.792064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.817729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.825882 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9369f0b-f88a-48d7-b37b-f9510f2aac9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.204752 May 26 18:08:19.826519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 233/428] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:19 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:19.942155 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.949934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c69db38f-1271-438e-9c71-a9602922dd87 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.170377 May 26 18:08:19.950547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 196/429] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:19 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:20.605573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:20.607085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:20.613999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.614533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:20.615236 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.615699 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:20.687794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:20.695580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a91d5856-6fde-4cbd-9910-2bca639da592 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1615 microversion: 2.1 time: 0.094175 May 26 18:08:20.696211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 234/430] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:20 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:20.851568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:20.852254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:20.861678 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.862461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:20.863474 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.864099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:20.961252 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3d3a2a7c-d66f-42b9-afc9-e198181f2130 req-b91c5297-82e5-4398-86e7-7ae9121254c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c10917-bf25-4d3c-990b-3c44c2b7847e", "name": "network-vif-deleted", "tag": "d9b2d18d-b65f-4926-afd9-c098ee263dcf"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:20.978066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3d3a2a7c-d66f-42b9-afc9-e198181f2130 req-b91c5297-82e5-4398-86e7-7ae9121254c3 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.981578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3d3a2a7c-d66f-42b9-afc9-e198181f2130 req-b91c5297-82e5-4398-86e7-7ae9121254c3 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.010781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3d3a2a7c-d66f-42b9-afc9-e198181f2130 req-b91c5297-82e5-4398-86e7-7ae9121254c3 service nova] Creating event network-vif-deleted:d9b2d18d-b65f-4926-afd9-c098ee263dcf for instance 80c10917-bf25-4d3c-990b-3c44c2b7847e on hv-cinder-83906 May 26 18:08:21.023668 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3d3a2a7c-d66f-42b9-afc9-e198181f2130 req-b91c5297-82e5-4398-86e7-7ae9121254c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063550 May 26 18:08:21.025471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 235/431] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:21.031898 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:21.032615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:21.043766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.044512 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.045474 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.046102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.118701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.131095 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f7303d0-45e2-4c94-a75b-307df6ccbb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.283703 May 26 18:08:21.146846 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 197/432] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:20 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:21.163919 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-177cefb4-67cf-42a8-98c1-3dc496998a1f req-1dd03ccd-2cc2-494f-b417-eef26dcbec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "name": "network-vif-plugged", "status": "completed", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:21.177883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-177cefb4-67cf-42a8-98c1-3dc496998a1f req-1dd03ccd-2cc2-494f-b417-eef26dcbec4f service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.178726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-177cefb4-67cf-42a8-98c1-3dc496998a1f req-1dd03ccd-2cc2-494f-b417-eef26dcbec4f service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.206105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-177cefb4-67cf-42a8-98c1-3dc496998a1f req-1dd03ccd-2cc2-494f-b417-eef26dcbec4f service nova] Creating event network-vif-plugged:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:08:21.222289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.228505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-177cefb4-67cf-42a8-98c1-3dc496998a1f req-1dd03ccd-2cc2-494f-b417-eef26dcbec4f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080374 May 26 18:08:21.232307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 198/433] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:21.233394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cfd99610-a5fb-4a7c-b3e1-b2a768815943 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.206511 May 26 18:08:21.234714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 236/434] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:21 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:21.719347 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:21.720557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:21.728461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.729052 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.729951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.730540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.814921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.818127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.818851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'fault' on Instance uuid 80c10917-bf25-4d3c-990b-3c44c2b7847e {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:21.910779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.934516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-62d636ef-7ee3-4009-8e8f-38a73c7a1892 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 200 len: 1332 microversion: 2.1 time: 0.221518 May 26 18:08:21.938588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 199/435] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:21 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 1332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:22.155115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.156531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:22.164263 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.164726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.165609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.166058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.257440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.258072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:22.265786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.266512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.267530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.268001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.327531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:22.336079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afeada23-5c9d-458c-b769-fdf38624132b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.186815 May 26 18:08:22.337327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 237/436] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:22 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:22.455154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:22.464102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8164b406-3634-48c3-8588-f1df3351d810 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.210767 May 26 18:08:22.465218 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 200/437] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:22 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:22.956389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.957097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:22.963485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.963932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.964714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.965735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.982044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e HTTP/1.1 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:08:22.983758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:08:22.985251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '80c10917-bf25-4d3c-990b-3c44c2b7847e'} May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:22.986140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:08:22.987557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:08:22.988712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:22.988712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-029f1e9f-c0d7-48ee-b52d-f07302119c71 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 404 len: 111 microversion: 2.1 time: 0.032933 May 26 18:08:22.988712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 238/438] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:22 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:22.994713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41a616ed-24f5-4ee0-a9ef-0f54dc259410 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '.version_select at 0x7f1fa03e5820>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.014970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41a616ed-24f5-4ee0-a9ef-0f54dc259410 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293654871" status: 202 len: 0 microversion: 2.1 time: 0.023980 May 26 18:08:23.015862 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 201/439] 10.222.0.76 () {58 vars in 1220 bytes} [Thu May 26 18:08:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293654871 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:23.308090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-facc2b6d-3bef-46bb-a06f-c324561e4dcc req-c7774288-b5ad-4df5-9a6b-81bb36c6bb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "name": "network-vif-plugged", "status": "completed", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:23.335877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-facc2b6d-3bef-46bb-a06f-c324561e4dcc req-c7774288-b5ad-4df5-9a6b-81bb36c6bb1b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.338458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-facc2b6d-3bef-46bb-a06f-c324561e4dcc req-c7774288-b5ad-4df5-9a6b-81bb36c6bb1b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.361598 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.362368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.369374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-facc2b6d-3bef-46bb-a06f-c324561e4dcc req-c7774288-b5ad-4df5-9a6b-81bb36c6bb1b service nova] Creating event network-vif-plugged:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:08:23.385342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-facc2b6d-3bef-46bb-a06f-c324561e4dcc req-c7774288-b5ad-4df5-9a6b-81bb36c6bb1b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086584 May 26 18:08:23.385662 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.386525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.389409 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.390525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.391597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 239/440] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:23.489313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.491753 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.505465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.506312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.507428 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.508133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.652177 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:23.661772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe9162dd-3237-46d4-8ba9-1c3e7a732a4c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1357 microversion: 2.1 time: 0.309103 May 26 18:08:23.672130 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 202/441] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:23.813769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:23.829416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2269e768-7212-4f13-89b7-5beaf08cc200 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.351570 May 26 18:08:23.842360 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 240/442] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:24.054985 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.056307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.064517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.065349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.066218 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.066700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.212631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'services' on Instance uuid 9288cf08-2b09-4c42-9831-8fbaa8f789ca {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:24.351183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6432e181-a242-44b2-833a-1166b57ca635 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments/49ac5aa0-9184-4099-a806-dc70d2bba06a" status: 202 len: 0 microversion: 2.1 time: 0.300809 May 26 18:08:24.351861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 203/443] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:08:24 2022] DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments/49ac5aa0-9184-4099-a806-dc70d2bba06a => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:24.361022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.362025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.381695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.382216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.383070 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.383631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.419535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b0054b40-febe-4d8a-a301-1d78dd07250f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062315 May 26 18:08:24.420119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 241/444] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:24.680902 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.681525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.688865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.689341 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.690093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.690558 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.850274 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:24.857611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.858698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.859749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2f1ee343-cc36-4065-84d6-882f22a64002 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1545 microversion: 2.1 time: 0.183278 May 26 18:08:24.860693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 204/445] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1545 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:24.866035 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.866626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.867508 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.867993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.879247 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.879861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.886574 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.887238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.888188 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.888637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.025813 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:25.035272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-22403615-e446-45db-baf2-cf96319de14b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.182703 May 26 18:08:25.036030 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 242/446] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:25.054915 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:25.064141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-11bb1170-0d1a-43c4-94a5-eed30561252f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1545 microversion: 2.1 time: 0.189291 May 26 18:08:25.064786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 205/447] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1545 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:25.081119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:25.084622 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:25.085292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Searching by: {'deleted': False, 'project_id': '98761773ea78490baebe0b3d9414ac45'} {{(pid=117832) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 18:08:25.092799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.093249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.094048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.094534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.225232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.multi_cell_list [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 18:08:25.327954 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2d4a279-0374-4806-b849-9b3c3b0f2688 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.250567 May 26 18:08:25.328548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 243/448] 10.222.0.76 () {58 vars in 1124 bytes} [Thu May 26 18:08:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:25.339788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:25.340530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:25.349948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.350445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.351216 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.351651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.432645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:25.433529 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:25.442996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.443317 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.444112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.444557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.447410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.477751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-53352d63-3d77-46d7-9dc0-ab3df8472fba tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050132 May 26 18:08:25.478363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 244/449] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:08:25 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:25.517267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:25.527451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5e47f820-ee8e-454d-a992-93ccf9d02f0e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1545 microversion: 2.1 time: 0.191653 May 26 18:08:25.528052 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 206/450] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:25 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1545 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:26.051843 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.052464 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:26.058932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.059402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.060183 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.060676 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.214535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:26.223385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d25a7e7-1114-4e34-ad26-f2ab81a7aceb tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1259 microversion: 2.1 time: 0.175200 May 26 18:08:26.223885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 245/451] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:26 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:26.490490 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.491521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:26.498642 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.499118 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.499871 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.500306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.535969 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-03841d2c-dd79-489e-8f7c-939485ad9e72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049396 May 26 18:08:26.536562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 207/452] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:08:26 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:27.184225 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d72453d-48dc-4761-a5a0-2f2ac1c66ac4"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:27.186247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.197327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.198150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.200079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.200891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.241568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.242542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.250523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.250980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.251763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.252208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.398603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:27.408045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-99f95788-db87-4b3c-8fbb-75611b421189 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1442 microversion: 2.1 time: 0.170704 May 26 18:08:27.408617 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 208/453] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:27 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:27.434610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.435737 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.451955 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.452413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.453213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.453661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.500435 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1255d0ba-0d5f-4d70-a349-00529f4fe99c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323648 May 26 18:08:27.501051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 246/454] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:08:27 2022] POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:27.551292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.552555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.561094 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.562024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.563589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.564505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.604367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:27.607837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75f1d303-323e-4a46-a6b2-8fda81fbe5e1 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061279 May 26 18:08:27.609465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 247/455] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:08:27 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:08:27.617296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f8d534ab-e06a-4567-aa87-818605ece339 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1442 microversion: 2.1 time: 0.187638 May 26 18:08:27.618235 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 209/456] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:27 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1442 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:27.682689 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.683526 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.692192 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.692644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.693711 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.694164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.723227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:27.825685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dfa9fc15-f4e7-48c3-a16f-2683b0f656fa tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 204 len: 0 microversion: 2.1 time: 0.145625 May 26 18:08:27.827067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 248/457] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:08:27 2022] DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:08:27.835577 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.836209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.852341 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.852801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.853589 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.854046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:28.087184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:28.095848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-022d1f22-77b2-4b0b-8ae1-8aff56710223 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1682 microversion: 2.1 time: 0.264349 May 26 18:08:28.097106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 210/458] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:27 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:29.115916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:29.116733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:29.124387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:29.124928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:29.125779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:29.126315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:29.277300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:29.286024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc311daa-b4af-4745-bc0b-1e3238c6896e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1682 microversion: 2.1 time: 0.174257 May 26 18:08:29.287015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 249/459] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:29 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:29.841059 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-949a555c-12fb-4f15-b8ff-2a8e2869f4fe req-172119a1-c04e-43b8-8b0c-09943e0f3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:29.850229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-949a555c-12fb-4f15-b8ff-2a8e2869f4fe req-172119a1-c04e-43b8-8b0c-09943e0f3f73 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:29.850689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-949a555c-12fb-4f15-b8ff-2a8e2869f4fe req-172119a1-c04e-43b8-8b0c-09943e0f3f73 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:29.864128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-949a555c-12fb-4f15-b8ff-2a8e2869f4fe req-172119a1-c04e-43b8-8b0c-09943e0f3f73 service nova] Creating event network-changed:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:08:29.869408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-949a555c-12fb-4f15-b8ff-2a8e2869f4fe req-172119a1-c04e-43b8-8b0c-09943e0f3f73 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033578 May 26 18:08:29.870014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 211/460] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:30.305570 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:30.307332 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:30.312336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.320647 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.321972 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.323095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.323883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.581941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:30.592853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2cec74d2-d2cc-4ea1-b3b5-ea0a56f9657f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1682 microversion: 2.1 time: 0.291454 May 26 18:08:30.593788 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 250/461] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:30 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1682 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:31.589011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7860889a-3f9f-468d-9a78-2c5db25abdd5 req-15334b9c-1269-414d-a5dd-6b785c586dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9288cf08-2b09-4c42-9831-8fbaa8f789ca", "name": "network-vif-deleted", "tag": "c6d58bd6-9928-4743-8a53-a4e8c97f7f99"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:31.598847 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7860889a-3f9f-468d-9a78-2c5db25abdd5 req-15334b9c-1269-414d-a5dd-6b785c586dfb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:31.599448 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7860889a-3f9f-468d-9a78-2c5db25abdd5 req-15334b9c-1269-414d-a5dd-6b785c586dfb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:31.611928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:31.612482 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:31.612627 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7860889a-3f9f-468d-9a78-2c5db25abdd5 req-15334b9c-1269-414d-a5dd-6b785c586dfb service nova] Creating event network-vif-deleted:c6d58bd6-9928-4743-8a53-a4e8c97f7f99 for instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca on hv-cinder-83906 May 26 18:08:31.619153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7860889a-3f9f-468d-9a78-2c5db25abdd5 req-15334b9c-1269-414d-a5dd-6b785c586dfb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 May 26 18:08:31.619792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 212/462] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:31.626926 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:31.627380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:31.628172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:31.628826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:31.703453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:31.712483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c596fb48-4bb1-4385-8704-a4b325803c8c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 200 len: 1614 microversion: 2.1 time: 0.105240 May 26 18:08:31.713075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 251/463] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:31 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:32.732219 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:32.732859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:32.739357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:32.739894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:32.740656 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:32.741089 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:32.755550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca HTTP/1.1 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:08:32.757260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:08:32.759058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '9288cf08-2b09-4c42-9831-8fbaa8f789ca'} May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:32.759891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:08:32.761048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:08:32.762065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:32.762065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-66d36bff-3a34-40be-b247-6900a3819268 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 404 len: 111 microversion: 2.1 time: 0.032310 May 26 18:08:32.762065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 213/464] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:32 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:32.767759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba15b136-ca58-40fd-ac93-2e368644ab2d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '.version_select at 0x7f1fa01fc700>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:32.786569 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba15b136-ca58-40fd-ac93-2e368644ab2d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645322864" status: 202 len: 0 microversion: 2.1 time: 0.022459 May 26 18:08:32.787135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 252/465] 10.222.0.76 () {58 vars in 1220 bytes} [Thu May 26 18:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645322864 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:33.430787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1206f1a8-6f54-41f7-9065-576dd81b92ec tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: .version_select at 0x7f1fa03c6280>, body: {"keypair": {"name": "tempest-keypair-688842202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7TMRhHbqyZBp+WMVovqEFYBwpRifyoHXwrgfGLGX1C72ye+DSZjVNPaEYSyeGSbQ1zRa0Mcjp90uoOSV1AmtKP77Yr/4D5XIkrpOKeCyQ80UGatwgOAF5RU5jQFgvmjw=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:33.446492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1206f1a8-6f54-41f7-9065-576dd81b92ec tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:33.452335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-1206f1a8-6f54-41f7-9065-576dd81b92ec tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:33.476299 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1206f1a8-6f54-41f7-9065-576dd81b92ec tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049328 May 26 18:08:33.476901 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 214/466] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:08:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:34.925159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563065678", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88540240-a343-4b80-bbe6-aa98a82d692f"}], "security_groups": [{"name": "tempest-securitygroup--1009504564"}], "key_name": "tempest-keypair-688842202", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:35.034140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] validate_networks() for [('88540240-a343-4b80-bbe6-aa98a82d692f', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:08:35.135148 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.441316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:08:35.441749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:08:35.442261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:08:35.442683 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:08:35.443246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:08:35.453554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:35.454178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:35.455092 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:35.455571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:35.475230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:35.479338 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:35.491402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:08:35.493672 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:08:35.552789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3101916d-3319-4d6e-a52d-44fc3b245884 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632541 May 26 18:08:35.553907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 253/467] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:08:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:08:35.566333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0e8ca83c-041b-4ea7-b24b-175e223b3ab6 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:35.568032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0e8ca83c-041b-4ea7-b24b-175e223b3ab6 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:35.631671 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e8ca83c-041b-4ea7-b24b-175e223b3ab6 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:35.640050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0e8ca83c-041b-4ea7-b24b-175e223b3ab6 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1240 microversion: 2.1 time: 0.078319 May 26 18:08:35.640649 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 215/468] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:35 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:36.502460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:36.503075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.510714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.511240 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.512121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.512861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.653130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lazy-loading 'services' on Instance uuid c8623e13-810b-433d-9e9d-e588bb5781eb {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:36.658917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:36.659827 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.670905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.671588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.672799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.673440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.749261 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:36.751861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.758900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3c8c1363-d3ff-4766-826f-5e2ce9f41b11 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1292 microversion: 2.1 time: 0.104846 May 26 18:08:36.759371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 216/469] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:36 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:36.782809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-12da7837-8fba-41a4-87e2-2a76f5aa0be1 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments/050b17a8-0c07-49a1-a42b-15853bcf1d84" status: 202 len: 0 microversion: 2.1 time: 0.286884 May 26 18:08:36.783395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 254/470] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:08:36 2022] DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments/050b17a8-0c07-49a1-a42b-15853bcf1d84 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:37.312806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:37.313450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:37.320073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.320520 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.321318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.321752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.462028 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.470895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-61cbe344-ec89-4ae1-851d-af6e00b376af tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1591 microversion: 2.1 time: 0.162339 May 26 18:08:37.471497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 217/471] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:37 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1591 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:37.785231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:37.787512 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:37.804139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.808047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.813277 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.814083 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.907232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.915822 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c9b3b02-75c0-410d-9178-b6de2e56de8e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1298 microversion: 2.1 time: 0.141822 May 26 18:08:37.917299 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 255/472] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:37 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:38.942752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:38.945154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:38.956142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.957054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.958608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.959743 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.044373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13ecf518-50bb-449a-97dd-73be8f845136 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:39.061481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13ecf518-50bb-449a-97dd-73be8f845136 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.062436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13ecf518-50bb-449a-97dd-73be8f845136 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.203460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13ecf518-50bb-449a-97dd-73be8f845136 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:08:39.269191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13ecf518-50bb-449a-97dd-73be8f845136 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action" status: 202 len: 0 microversion: 2.1 time: 0.233085 May 26 18:08:39.270049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 256/473] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:08:39 2022] POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:39.277883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.290831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-86a588d0-9189-457b-beef-9fb58f24cd7c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.357939 May 26 18:08:39.292711 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:39.293700 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:39.296216 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 218/474] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:38 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:39.302150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.303016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.304064 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.304673 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.562248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.564641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.576221 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3266b5b1-b41b-4e31-a019-664c6f091384 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.292577 May 26 18:08:39.576704 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 257/475] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:39 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:39.771367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-b3e42ab7-8db8-49d8-a9ac-a1e557b0fbe5 req-cb2f9657-2ffd-445f-a5ff-feb93c9363ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d1c756-d845-43f2-8ec2-0767b6a3be7f", "tag": "3c239d26-0866-4946-be79-fa64dcd4b725"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:39.801099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b3e42ab7-8db8-49d8-a9ac-a1e557b0fbe5 req-cb2f9657-2ffd-445f-a5ff-feb93c9363ad service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.802297 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b3e42ab7-8db8-49d8-a9ac-a1e557b0fbe5 req-cb2f9657-2ffd-445f-a5ff-feb93c9363ad service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.849068 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-b3e42ab7-8db8-49d8-a9ac-a1e557b0fbe5 req-cb2f9657-2ffd-445f-a5ff-feb93c9363ad service nova] Creating event network-changed:3c239d26-0866-4946-be79-fa64dcd4b725 for instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f on hv-cinder-83906 May 26 18:08:39.860636 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-b3e42ab7-8db8-49d8-a9ac-a1e557b0fbe5 req-cb2f9657-2ffd-445f-a5ff-feb93c9363ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095115 May 26 18:08:39.867956 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 219/476] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:39.908416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-e7e9c690-c701-42a8-b54f-8c10ed714a16 req-ae044169-b6c0-43fb-a906-5fcbe8581cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:39.921010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e7e9c690-c701-42a8-b54f-8c10ed714a16 req-ae044169-b6c0-43fb-a906-5fcbe8581cdc service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.922432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e7e9c690-c701-42a8-b54f-8c10ed714a16 req-ae044169-b6c0-43fb-a906-5fcbe8581cdc service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.942868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-e7e9c690-c701-42a8-b54f-8c10ed714a16 req-ae044169-b6c0-43fb-a906-5fcbe8581cdc service nova] Creating event network-changed:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:08:39.952306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-e7e9c690-c701-42a8-b54f-8c10ed714a16 req-ae044169-b6c0-43fb-a906-5fcbe8581cdc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048661 May 26 18:08:39.953000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 258/477] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:40.314955 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:40.316527 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:40.324805 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.325540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.326593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.327208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.606607 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:40.607395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:40.621935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.624238 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.625119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.629243 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.663152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:40.673059 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b3220936-f90d-4a6b-8743-0da1b242d013 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.362443 May 26 18:08:40.674102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 220/478] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:40 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:40.832911 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:40.843774 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa9a6e5b-08a5-4c02-af6b-e0bfe30c1c93 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.242746 May 26 18:08:40.853926 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 259/479] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:40 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:41.679192 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1077596327"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:41.679861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.687983 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.688436 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.689205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.689750 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.691112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.691733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.701329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.701801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.702714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.703160 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.850473 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.network.security_group_api [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Adding security group eea1309d-f568-4505-b38c-3ce75016ea77 to port e68fb5bc-371c-476f-9c1e-c7d20160dd7d May 26 18:08:41.859773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.868094 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e748c4a6-f571-4169-995c-9222eb97de40 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.180716 May 26 18:08:41.868745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 260/480] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:41.874906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.875524 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.882539 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.882914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.883789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.884331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.094354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.102312 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-effceaba-832b-41ff-8e77-ef901a56d7e2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.232506 May 26 18:08:42.103097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 261/481] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:42.341718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8746236d-483a-4ca9-b9d0-409b68a1c3d5 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action" status: 202 len: 0 microversion: 2.1 time: 0.664939 May 26 18:08:42.353856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d34e866c-a89f-49ff-aafd-e5043ed4982d req-4c53c491-7d85-4e4f-99fc-0b3c4559e8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:42.356689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 221/482] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:08:41 2022] POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:42.369257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:42.370042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:42.370454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d34e866c-a89f-49ff-aafd-e5043ed4982d req-4c53c491-7d85-4e4f-99fc-0b3c4559e8f6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.371575 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d34e866c-a89f-49ff-aafd-e5043ed4982d req-4c53c491-7d85-4e4f-99fc-0b3c4559e8f6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.390844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d34e866c-a89f-49ff-aafd-e5043ed4982d req-4c53c491-7d85-4e4f-99fc-0b3c4559e8f6 service nova] Creating event network-changed:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:08:42.392000 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.392455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.393236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.393715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.395889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d34e866c-a89f-49ff-aafd-e5043ed4982d req-4c53c491-7d85-4e4f-99fc-0b3c4559e8f6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050431 May 26 18:08:42.396891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 262/483] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:42.653542 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.665307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d4c5cd8f-d7d8-494f-a6d0-86018e56234c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1638 microversion: 2.1 time: 0.307621 May 26 18:08:42.667329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 222/484] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:42 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1638 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:42.891306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:42.892579 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:42.906734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.907435 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.908463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.909168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.094030 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.102159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-771bb791-fbde-4bae-894e-3801e223a778 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.218912 May 26 18:08:43.102785 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 263/485] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:42 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:43.121626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.122801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.131441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.132140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.133416 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.134088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.410570 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.422247 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dcbedbb7-1189-488a-a1ad-f9b74f2a94d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.305011 May 26 18:08:43.435890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 223/486] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:44.121671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.122401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.129548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.130404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.131269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.131707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.283025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.294389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-111f782d-599a-4abb-9ff2-a0b7006c067b tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.176855 May 26 18:08:44.295350 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 264/487] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:44.444981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.445690 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.453255 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.453805 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.454693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.455226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.621520 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.631853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cbc975b0-1a08-4c0a-94c5-8d3032d6ab81 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.190681 May 26 18:08:44.632707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 224/488] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:45.312483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.313106 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.320651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.321387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.322559 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.322858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.462508 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.467385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:45.476166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-48ba8750-01e9-439d-aea6-2e24b89cb2fc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.168155 May 26 18:08:45.476773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 265/489] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:45.650065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.650727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.655368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.660166 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.660623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.661426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.661876 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.679774 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cecbc6f5-a5ef-480c-a1eb-24eb16c48e11 req-c30f0c97-3fcc-4647-ae26-e253b58dab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d1c756-d845-43f2-8ec2-0767b6a3be7f", "name": "network-vif-plugged", "status": "completed", "tag": "3c239d26-0866-4946-be79-fa64dcd4b725"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:45.686503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.701063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cecbc6f5-a5ef-480c-a1eb-24eb16c48e11 req-c30f0c97-3fcc-4647-ae26-e253b58dab05 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.701929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cecbc6f5-a5ef-480c-a1eb-24eb16c48e11 req-c30f0c97-3fcc-4647-ae26-e253b58dab05 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.719696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cecbc6f5-a5ef-480c-a1eb-24eb16c48e11 req-c30f0c97-3fcc-4647-ae26-e253b58dab05 service nova] Creating event network-vif-plugged:3c239d26-0866-4946-be79-fa64dcd4b725 for instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f on hv-cinder-83906 May 26 18:08:45.728751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cecbc6f5-a5ef-480c-a1eb-24eb16c48e11 req-c30f0c97-3fcc-4647-ae26-e253b58dab05 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054677 May 26 18:08:45.729681 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 266/490] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:45.858020 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:45.873909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-192e82d3-6a4b-480e-8fdd-2bcde7277144 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.227494 May 26 18:08:45.874956 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 225/491] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:46.494862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:46.495566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:46.506684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:46.507248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.508146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:46.508622 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.662082 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.670730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d4aa4d5-e49e-4f51-ab82-424b55745d5d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.179960 May 26 18:08:46.671328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 267/492] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:46 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:46.895751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:46.896305 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:46.898707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.905330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:46.905786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.906604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:46.907040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.050538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.059534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8a8416be-56ff-47e4-8779-fcd45e4c8ac2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.167653 May 26 18:08:47.060456 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 226/493] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:46 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:47.689330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:47.690000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:47.697730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.698223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.699730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.700266 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.859034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.867634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e5b2d40-37da-451e-9903-c34dbf424c22 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1366 microversion: 2.1 time: 0.182522 May 26 18:08:47.868242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 268/494] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:47 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:48.077347 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.077978 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.085123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.085580 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.086419 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.086864 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.239326 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.248403 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b770c253-7978-42ac-af5a-3a02395c541b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.175571 May 26 18:08:48.249068 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 227/495] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:48.885408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.885963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.893237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.893707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.894504 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.894946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.040309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:49.048899 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d65a5a5-85da-4701-ae37-ea8ad059af72 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1556 microversion: 2.1 time: 0.167421 May 26 18:08:49.049527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 269/496] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:49.066551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:49.067712 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:49.073663 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.075708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.075708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.075708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.160579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5b6c4d10-c034-4399-a233-67476463d25e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097994 May 26 18:08:49.161245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 228/497] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:08:49 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:49.265922 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:49.266560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:49.272716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.273196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.273939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.274417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.419790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:49.427476 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-53c3f976-1b8c-470c-b136-76adf5c25b6d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.166040 May 26 18:08:49.428047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 270/498] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:49 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:50.122602 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9562d653-c847-4bfd-8458-7716165911d7 req-cf93b76f-5102-4c61-9016-3633045f3262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d1c756-d845-43f2-8ec2-0767b6a3be7f", "tag": "3c239d26-0866-4946-be79-fa64dcd4b725"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:50.131238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9562d653-c847-4bfd-8458-7716165911d7 req-cf93b76f-5102-4c61-9016-3633045f3262 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.131856 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9562d653-c847-4bfd-8458-7716165911d7 req-cf93b76f-5102-4c61-9016-3633045f3262 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.145579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9562d653-c847-4bfd-8458-7716165911d7 req-cf93b76f-5102-4c61-9016-3633045f3262 service nova] Creating event network-changed:3c239d26-0866-4946-be79-fa64dcd4b725 for instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f on hv-cinder-83906 May 26 18:08:50.150370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9562d653-c847-4bfd-8458-7716165911d7 req-cf93b76f-5102-4c61-9016-3633045f3262 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 May 26 18:08:50.151078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 229/499] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:50.446145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:50.447801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:50.462697 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.463316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.464298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.465702 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.643767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:50.651802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-62a5db77-47d0-4bf2-8ee5-844a76b820df tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.210319 May 26 18:08:50.654516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 271/500] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:50 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:51.671968 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.672592 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.679423 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.679876 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.680709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.681152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.827017 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.835483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8fb1480b-76f6-40f2-9b9d-916ee9ae8257 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.168765 May 26 18:08:51.836179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 230/501] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:51 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:52.853544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.854162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.861282 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.861736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.862560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.863008 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.010814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:53.021425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52563011-f3ba-418c-9655-24a19a6ab6ce tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.171543 May 26 18:08:53.022470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 272/502] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:52 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:54.040993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:54.041647 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:54.048465 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.048919 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.049702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.050142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.196280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:54.205395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9973228c-505f-47ca-87c6-0aefae23303d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1679 microversion: 2.1 time: 0.168273 May 26 18:08:54.205990 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 231/503] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:54 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:55.205436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4869a1-a3a5-4364-8e74-4ad40e0ce102"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:55.206562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:55.213415 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.214295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.214752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.215498 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.223040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:55.223665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:55.232327 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.232785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.233573 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.234011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.401253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.410829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fd343485-82b3-4065-a1b3-ccbff013f5b6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1656 microversion: 2.1 time: 0.191464 May 26 18:08:55.416840 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 232/504] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:55 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1656 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:55.439325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2f1fbb7-be1f-4808-af44-63e583c8c2d5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:55.446513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2f1fbb7-be1f-4808-af44-63e583c8c2d5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.446969 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2f1fbb7-be1f-4808-af44-63e583c8c2d5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.476316 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2f1fbb7-be1f-4808-af44-63e583c8c2d5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Going to try to start instance {{(pid=117833) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:08:55.546101 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2f1fbb7-be1f-4808-af44-63e583c8c2d5 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action" status: 202 len: 0 microversion: 2.1 time: 0.111346 May 26 18:08:55.546793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 233/505] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:08:55 2022] POST /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:55.557250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:55.557993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:55.565303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.565754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.566776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.567885 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.580437 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e01356c-2000-46a5-9ec7-8575f27d1ec3 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378811 May 26 18:08:55.581433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 273/506] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:08:55 2022] POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:55.588366 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:55.725079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.734970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2b1b7e1-6ac0-4449-b047-deb8cfd2cc9b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1665 microversion: 2.1 time: 0.182646 May 26 18:08:55.735608 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 234/507] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:55 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1665 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:56.753842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:56.754573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:56.761310 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.761781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.762616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.763105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.905218 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.912923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d4471b2-3f1b-42ea-91c6-edb55c65a7b3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1665 microversion: 2.1 time: 0.164021 May 26 18:08:56.913501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 274/508] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:56 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:57.933704 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:57.934373 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:57.941408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.941865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.942694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.943134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.097393 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.106007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7f639765-a558-4886-b667-ae102b1ea655 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1669 microversion: 2.1 time: 0.176332 May 26 18:08:58.106639 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 235/509] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:08:57 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:03.222008 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:03.223090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:03.225963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.234357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.234812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.235603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.236034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.239313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.268465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'flavor' on Instance uuid 3eceefa8-c466-4e82-b5b7-9458d4cd6775 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:09:03.405837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad3603ac-ece7-4ecc-878e-7616fc61277f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/action" status: 200 len: 32 microversion: 2.1 time: 0.187822 May 26 18:09:03.406610 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 275/510] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:09:03 2022] POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:09:03.416030 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:03.417426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:03.426595 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.427191 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.428057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.428715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.655189 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:03.667580 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8c74f3ee-855a-4ed6-86ba-1fbf03571e57 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.255588 May 26 18:09:03.668375 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 236/511] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:03 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:04.699987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:04.701274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:04.711860 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.712680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.714017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.715402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.896960 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:04.906609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9e8c5b57-2d1e-46a1-92c8-0f0bef6d4b8b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.216175 May 26 18:09:04.907437 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 276/512] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:04 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:05.925550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:05.926417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:05.933034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.933635 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.934454 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.934897 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.081628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:06.090513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0470e3ef-9767-476b-a263-2c33ab91d8eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.168668 May 26 18:09:06.091269 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 237/513] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:05 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:07.107662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:07.108274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:07.115453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.115961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.116725 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.117167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.294133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:07.305670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c1eee48-f443-4e8d-a85e-a1d84c4c5bd6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.202046 May 26 18:09:07.306283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 277/514] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:07 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:08.326060 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:08.326716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:08.333718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.334170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.334970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.335409 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.477402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:08.487497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-435dc2bd-577c-461d-a5bf-f94eadc69f32 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.166513 May 26 18:09:08.488081 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 238/515] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:08 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:09.505239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:09.505928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:09.513241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.513749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:09.514645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.515130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:09.656625 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:09.668857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f7d501d1-952b-430a-83a5-150140111a53 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.167549 May 26 18:09:09.669463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 278/516] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:09 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:10.689683 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:10.690669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:10.697712 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:10.698307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:10.699174 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:10.699610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:10.852292 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:10.864479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-54a6d646-f78c-4bc2-ba51-117a2411be73 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.181406 May 26 18:09:10.865077 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 239/517] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:10 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:11.882588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:11.883431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:11.890929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.891399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:11.892180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.892627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:12.052372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:12.062234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e56e0000-dde8-4662-96dd-928a36a1952e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.183579 May 26 18:09:12.062826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 279/518] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:11 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:13.083568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:13.084849 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:13.091917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.092374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.093173 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.093626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.252180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:13.260513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-474bee9e-d289-4fdb-aa30-78da0c811c25 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.183872 May 26 18:09:13.261293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 240/519] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:13 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:14.286086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:14.286711 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:14.293345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.293794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.294599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.295033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.440597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:14.450133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8dea9a6-3fbb-4dfc-9e3c-92812a8ca09a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.167238 May 26 18:09:14.450757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 280/520] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:14 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:15.469128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:15.469761 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:15.476292 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.476746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.477521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.477957 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.612888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:15.622412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8c67105-839e-40e5-9c09-bdff3c39e4f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.157534 May 26 18:09:15.623011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 241/521] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:15 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:16.640599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:16.641196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:16.648044 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:16.648556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:16.649345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:16.649786 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:16.813279 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:16.822141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31308660-a812-43c1-88c8-1f1fbea090fa tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.186289 May 26 18:09:16.822761 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 281/522] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:16 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:17.840684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:17.841317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.843871 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=32 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.849356 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.849805 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.850625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.850974 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:17.851446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.852834 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.865332 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.866155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.867619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.868434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.962174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a7efebbf-bba4-4091-8fdb-6e9815345a17 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action" status: 202 len: 0 microversion: 2.1 time: 0.118274 May 26 18:09:17.967441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 282/523] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:09:17 2022] POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:09:17.974644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:17.975598 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.985231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.986056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.987327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.987987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.037880 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:18.047767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-680f3d48-bbee-4560-95bd-237672c2e78e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.211947 May 26 18:09:18.048376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 242/524] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:17 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:18.188638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:18.203801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-657b582f-bd74-47f8-995f-50e6ab45127c tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1748 microversion: 2.1 time: 0.234269 May 26 18:09:18.204903 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 283/525] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:17 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1748 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:19.065246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:19.065853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.073089 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.074721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.075539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.075980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.222380 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:19.223562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:19.224397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.230750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.231208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.231356 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8c0c7e06-a163-40ca-9644-60d920c7b76c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.170104 May 26 18:09:19.231943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 243/526] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:19 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:19.232089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.232425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.382324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:19.391995 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70951840-3687-41fa-96ec-a656e5d97eab tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.172365 May 26 18:09:19.392594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 284/527] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:19 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:20.248882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:20.249515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:20.256451 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.256907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.257683 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.258129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.391370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.399650 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81b273f6-633a-400e-942d-de4cc16644a7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.154752 May 26 18:09:20.400150 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 244/528] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:20 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:20.408856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:20.409550 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:20.416144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.416590 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.417349 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.417781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.572945 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.582075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-18fe1451-b6d5-4629-a225-e83e699f01ec tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.176859 May 26 18:09:20.582700 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 285/529] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:20 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:21.416937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:21.418367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:21.424888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.425343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.426110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.426585 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.556388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.564680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7057da92-e746-4d1c-8e49-c09c45a5635a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.151664 May 26 18:09:21.565268 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 245/530] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:21 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:21.600894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:21.602257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:21.609090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.609541 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.610394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.610832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.763306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.772410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bdff21dc-9132-478e-a55d-997fe07c130b tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.175847 May 26 18:09:21.773056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 286/531] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:21 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:22.581353 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:22.581997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:22.589792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.590284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.591094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.591567 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.756557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.765795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8c32f290-83fc-4cc4-9658-ed5140915706 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1735 microversion: 2.1 time: 0.188580 May 26 18:09:22.766422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 246/532] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:22 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:22.790227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:22.791241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:22.797988 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.798469 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.799251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.799693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.957125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.966030 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4c9aa95d-86d8-4d7e-bd0f-7468715f5e04 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.179570 May 26 18:09:22.966645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 287/533] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:22 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:23.783016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:23.783656 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:23.790298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.790756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.791529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.792074 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.925331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:23.934089 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f3c67ba9-4662-4c50-826e-f2b58e1eea9b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1715 microversion: 2.1 time: 0.155147 May 26 18:09:23.934689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 247/534] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:23 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:23.984406 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:23.984943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:23.989490 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:23.989993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:23.991486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.991934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.992700 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.993134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.996416 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.996898 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.997669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.998149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.092022 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] HTTP exception thrown: Cannot 'detach_volume' instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 while it is in vm_state rescued May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Request method failure captured: May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments/8d4869a1-a3a5-4364-8e74-4ad40e0ce102 HTTP/1.1 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FP-eQmwCVvErdsoZ2kdT4qUsb86lF3Tz1lSgt3fZPaSuKQ5DbcnASrdG6Ld_I0wPlhDSwdF5Gc8u_HrJ_43tU9wFSPrsrQHa8WTSGhh4QwT894Nk4R5qJGRjKDFTwKwHYRkJx-NBt8Hdx_JQSmweFz7eHMXOgr58XUGkQbwOl5lOE May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:09:24.093694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 61f6dbd4328e459eb7d4f029551648bb May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:09:24.095246 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Cannot 'detach_volume' instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 while it is in vm_state rescued May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '3eceefa8-c466-4e82-b5b7-9458d4cd6775', 'id': '8d4869a1-a3a5-4364-8e74-4ad40e0ce102'} May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:24.095970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 while it is in vm_state rescued May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 while it is in vm_state rescued May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:24.098041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Returning 409 to user: Cannot 'detach_volume' instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 while it is in vm_state rescued {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:24.100933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1d569fb5-9bb7-4c6b-bac7-df9dde2caaa8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments/8d4869a1-a3a5-4364-8e74-4ad40e0ce102" status: 409 len: 152 microversion: 2.1 time: 0.109651 May 26 18:09:24.100933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 248/535] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:09:23 2022] DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments/8d4869a1-a3a5-4364-8e74-4ad40e0ce102 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 18:09:24.106112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:24.106755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:24.113835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.114322 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.115106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.115550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.152790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.155435 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:24.163933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fdc4a50d-2553-4aad-90e7-bc7fd3bccc53 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.184125 May 26 18:09:24.164536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 288/536] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:23 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:24.193378 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6540dc00-fb8d-4fa5-8c55-06ad59dbe97c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/action" status: 202 len: 0 microversion: 2.1 time: 0.092052 May 26 18:09:24.197010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 249/537] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:09:24 2022] POST /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:09:24.203165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:24.203793 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:24.211265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.211742 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.212501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.212941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.347344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.355522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-25f12499-e248-4b28-bdac-f28b46b1f2f7 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1723 microversion: 2.1 time: 0.157097 May 26 18:09:24.356107 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 289/538] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:24 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:25.186331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:25.187103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:25.194537 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.195212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.196005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.196776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.200883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:25.372962 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:25.373637 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:25.379757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.382011 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.383428 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.385714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.386170 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.388390 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00dbfe0d-784f-4734-977d-413430e3a5c6 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.209687 May 26 18:09:25.388985 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 250/539] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:25 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:25.535368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.544095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b7feaf76-1983-4120-a395-c6105c2f0645 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1723 microversion: 2.1 time: 0.175016 May 26 18:09:25.544715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 290/540] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:25 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:26.408417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:26.408995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:26.416051 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.416515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.418035 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.418669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.563732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:26.564605 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:26.573837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.574560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.575800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.576400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.577503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.586533 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f3eb548-f2a9-4656-8c28-7d721d74bd54 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.183110 May 26 18:09:26.587359 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 251/541] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:26 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:26.728990 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.737612 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d743ce2b-30aa-4cde-8530-592458528bd0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1723 microversion: 2.1 time: 0.179675 May 26 18:09:26.738178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 291/542] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:26 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:27.604261 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.605039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.611612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.612069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.612840 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.613284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.755057 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.755791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.762846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.763313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.764100 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.764548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.772340 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.781507 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-76bfc5d1-4caf-4638-88d0-c67afe62c668 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.180206 May 26 18:09:27.782108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 252/543] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:27 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:27.906713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.915037 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3e107d5-f2d9-4504-9360-3fd6dc0b965e tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1723 microversion: 2.1 time: 0.163705 May 26 18:09:27.915629 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 292/544] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:27 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:28.799689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:28.800318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:28.807316 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.808345 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.809137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.809578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.933828 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:28.934439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:28.941182 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.941995 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.943410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.944208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.968187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:28.976410 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f5fe098b-ec0e-4082-8898-a85525fc994a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.180707 May 26 18:09:28.976995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 253/545] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:28 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:29.083889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:29.094332 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4521fc38-aeb3-466e-be7e-fde1092fa45c tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1729 microversion: 2.1 time: 0.164839 May 26 18:09:29.094917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 293/546] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:28 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:29.114522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:29.115029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:29.121349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.121808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.122620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.123088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.208172 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff6a42c5-944e-47c7-a92d-4893b2d089c2 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097540 May 26 18:09:29.208970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 254/547] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:09:29 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:29.995027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:29.995810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:30.002345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.002872 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.003660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.004110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.165711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9df316f1-3c9d-42ee-a821-2d5d04a5a271 req-ad022ea1-c474-4fc5-b076-f341795465ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:30.178284 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:30.181489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9df316f1-3c9d-42ee-a821-2d5d04a5a271 req-ad022ea1-c474-4fc5-b076-f341795465ae service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.182023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9df316f1-3c9d-42ee-a821-2d5d04a5a271 req-ad022ea1-c474-4fc5-b076-f341795465ae service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.187274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3370567e-42bc-4027-b695-ccf168f6bb35 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.196374 May 26 18:09:30.191261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 294/548] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:29 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:30.205124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9df316f1-3c9d-42ee-a821-2d5d04a5a271 req-ad022ea1-c474-4fc5-b076-f341795465ae service nova] Creating event network-changed:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:09:30.210365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9df316f1-3c9d-42ee-a821-2d5d04a5a271 req-ad022ea1-c474-4fc5-b076-f341795465ae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054022 May 26 18:09:30.211284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 255/549] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:31.206606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:31.207202 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:31.214141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:31.214808 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:31.215799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:31.216239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:31.368890 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:31.378778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e60a0e76-de2b-4289-a115-28c5206feb9a tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.176577 May 26 18:09:31.379367 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 295/550] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:31 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:32.227913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ff3411cf-5e86-449a-8148-8a84947f6eb3 req-54ea8f86-9562-4af3-a328-e04fab219dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:32.237023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ff3411cf-5e86-449a-8148-8a84947f6eb3 req-54ea8f86-9562-4af3-a328-e04fab219dae service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.237468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ff3411cf-5e86-449a-8148-8a84947f6eb3 req-54ea8f86-9562-4af3-a328-e04fab219dae service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.249978 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ff3411cf-5e86-449a-8148-8a84947f6eb3 req-54ea8f86-9562-4af3-a328-e04fab219dae service nova] Creating event network-changed:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:09:32.254878 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ff3411cf-5e86-449a-8148-8a84947f6eb3 req-54ea8f86-9562-4af3-a328-e04fab219dae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 May 26 18:09:32.255486 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 256/551] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:32.397237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:32.397886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:32.405148 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.405562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.406369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.406810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.571563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:32.580919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f4be88a-0cc4-41e5-855b-4e11d91621fb tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.187482 May 26 18:09:32.581517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 296/552] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:32 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:33.607961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:33.609295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:33.618735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.619193 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.620031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.620463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.780046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:33.788651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-63c68daa-55f9-4805-a866-16b40b220de7 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.191060 May 26 18:09:33.789256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 257/553] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:33 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:34.811397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:34.812495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:34.816405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=44 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:34.825690 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.826143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.827050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.827486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.987521 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:34.996787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-00c25389-77c7-4752-95ba-936ce0d8fa0f tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1753 microversion: 2.1 time: 0.193345 May 26 18:09:34.997381 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 297/554] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:34 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:36.014813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:36.015426 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:36.022338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:36.022794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:36.023578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:36.024017 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:36.181698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:36.190637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2a640a7-d89b-4de3-ae50-916c20bde550 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1756 microversion: 2.1 time: 0.180239 May 26 18:09:36.191237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 258/555] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:36 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:36.987710 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:36.988407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:36.995068 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:36.995531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:36.996327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:36.996774 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:37.022856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11e26d60-3f36-4471-a6fd-84f9e78816cf tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/ips" status: 200 len: 149 microversion: 2.1 time: 0.038966 May 26 18:09:37.023430 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 298/556] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:09:36 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:38.374090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:38.375188 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:38.381727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:38.382181 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:38.383002 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:38.383445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:38.645162 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-703584c6-bd30-4790-9c7a-04b1a3f7a8b9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274998 May 26 18:09:38.645982 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 259/557] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:09:38 2022] POST /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:46.162693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:46.163772 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:46.171743 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.172209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.173022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.173529 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.426003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments HTTP/1.1 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 74 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:09:46.427852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4"}} May 26 18:09:46.429436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'server_id': '55d1c756-d845-43f2-8ec2-0767b6a3be7f', 'body': {'volumeAttachment': {'volumeId': 'e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4'}}} May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:09:46.430295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:46.431682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 400 to user: Invalid volume: volume e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 is already attached to instances: 55d1c756-d845-43f2-8ec2-0767b6a3be7f {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6382b180-00be-4b60-a513-7e0e8e5fa429 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270973 May 26 18:09:46.433787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 299/558] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:09:46 2022] POST /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:46.496141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:46.496736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:46.503790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.504258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.505112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.505625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.645231 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'services' on Instance uuid 55d1c756-d845-43f2-8ec2-0767b6a3be7f {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:09:46.715954 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-09a14da3-2164-43ea-995b-c5b3f5df2bef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments/e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4" status: 202 len: 0 microversion: 2.1 time: 0.225729 May 26 18:09:46.716543 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 260/559] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:09:46 2022] DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments/e7ef30ba-1e2f-449e-88cf-7f2fd36d57b4 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:09:46.724712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:46.725759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:46.732623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.733081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.733875 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.734359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.765798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca6507c9-463b-484d-aea6-1612cc6ff7f0 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 May 26 18:09:46.766408 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 300/560] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:09:46 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:47.778934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:47.780280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:47.787528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:47.787818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:47.788385 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:47.789212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:47.824429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3283a6b7-be83-44a3-899d-a39ac5b9d03f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050432 May 26 18:09:47.825037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 261/561] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:09:47 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:48.840290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:48.841865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:48.851693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:48.852504 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:48.853619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:48.854406 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:48.892228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db4eddc5-86c3-4463-a087-268923273576 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058937 May 26 18:09:48.892828 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 301/562] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:09:48 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:09:48.971751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:48.972318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:48.974726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=40 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:48.980225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:48.980679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:48.981465 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:48.981905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:49.015527 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:09:49.109284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-93278e51-553d-4664-a8fa-c3b61c97790f tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 204 len: 0 microversion: 2.1 time: 0.141055 May 26 18:09:49.110329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 262/563] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:09:48 2022] DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:09:49.122694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:49.123837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:49.132161 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:49.132696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:49.133639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:49.134156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:49.276457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:49.284645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-724e6a85-9220-4a9c-abfb-d6ebb630a1f8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1680 microversion: 2.1 time: 0.169260 May 26 18:09:49.285324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 302/564] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:49 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:50.303058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:50.303790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:50.310495 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:50.310951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:50.311729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:50.312170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:50.452848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:50.461631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff9b052e-1033-4130-8fa6-537aa6e9eb17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1680 microversion: 2.1 time: 0.162833 May 26 18:09:50.462243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 263/565] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:50 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:51.480237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:51.481165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:51.488211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:51.488667 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:51.489502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:51.489943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:51.642057 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:51.650604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-363059e6-97a2-4f5f-a432-521f49f6bfca tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1680 microversion: 2.1 time: 0.174465 May 26 18:09:51.651857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 303/566] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:51 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:52.150915 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-8204db87-1504-4aa6-a36c-a7fac01b9ccd req-7868df0d-1559-4e7b-82a7-1e0957a8f371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d1c756-d845-43f2-8ec2-0767b6a3be7f", "name": "network-vif-deleted", "tag": "3c239d26-0866-4946-be79-fa64dcd4b725"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:52.169157 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8204db87-1504-4aa6-a36c-a7fac01b9ccd req-7868df0d-1559-4e7b-82a7-1e0957a8f371 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:52.169975 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8204db87-1504-4aa6-a36c-a7fac01b9ccd req-7868df0d-1559-4e7b-82a7-1e0957a8f371 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:52.185653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-8204db87-1504-4aa6-a36c-a7fac01b9ccd req-7868df0d-1559-4e7b-82a7-1e0957a8f371 service nova] Creating event network-vif-deleted:3c239d26-0866-4946-be79-fa64dcd4b725 for instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f on hv-cinder-83906 May 26 18:09:52.194961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-8204db87-1504-4aa6-a36c-a7fac01b9ccd req-7868df0d-1559-4e7b-82a7-1e0957a8f371 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055691 May 26 18:09:52.196238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 264/567] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:52.682545 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:52.685994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:52.696664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:52.699407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:52.700233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:52.700233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:52.747219 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:52.747675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:52.748317 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'fault' on Instance uuid 55d1c756-d845-43f2-8ec2-0767b6a3be7f {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:09:52.805540 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:52.814012 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4450322d-dfbc-4c30-ac30-00772aaeb437 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 200 len: 1330 microversion: 2.1 time: 0.139160 May 26 18:09:52.814631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 304/568] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:52 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:53.833979 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:53.834712 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:53.841709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:53.842334 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:53.843170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:53.843751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:53.860302 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f HTTP/1.1 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:09:53.862256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:09:53.863793 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '55d1c756-d845-43f2-8ec2-0767b6a3be7f'} May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:53.864654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:09:53.866100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:09:53.867445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:53.867445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de36a3a2-0aa8-4abc-89a1-10b1a73113d4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 404 len: 111 microversion: 2.1 time: 0.034668 May 26 18:09:53.867445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 265/569] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:53 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:09:53.874369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59a2e891-66b4-4f0a-9ed6-78185057e3ed tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '.version_select at 0x7f1fa0089d30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:53.895325 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59a2e891-66b4-4f0a-9ed6-78185057e3ed tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688842202" status: 202 len: 0 microversion: 2.1 time: 0.025480 May 26 18:09:53.896504 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 305/570] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 26 18:09:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688842202 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:09:54.605568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6afab7fc-6127-45e6-91b9-cdcbf904f373 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: .version_select at 0x7f1fa0244040>, body: {"keypair": {"name": "tempest-keypair-236212568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESzvkqDqAIrP6XbI33z7XcqenNS8m6uoAncGD0VIVIxSl3VBrjiBSr6ar9iRTEopyV6BiKhV6ufu+jAyNXyagMGUzqIHycfQVxdgrw6erJDJIdQppiQ3cgz42RRZgYQ0g=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:54.621100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-6afab7fc-6127-45e6-91b9-cdcbf904f373 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:09:54.625594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-6afab7fc-6127-45e6-91b9-cdcbf904f373 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:09:54.650826 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6afab7fc-6127-45e6-91b9-cdcbf904f373 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049963 May 26 18:09:54.651710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 266/571] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:09:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:56.221131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1515828918", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88540240-a343-4b80-bbe6-aa98a82d692f"}], "security_groups": [{"name": "tempest-securitygroup--1846453660"}], "key_name": "tempest-keypair-236212568", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:56.339707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] validate_networks() for [('88540240-a343-4b80-bbe6-aa98a82d692f', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:09:56.798826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:09:56.799253 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:09:56.799735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:09:56.800148 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:09:56.800566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:09:56.810973 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:56.811424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:56.812235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:56.812674 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:56.820131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:56.832856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:09:56.837483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Getting quotas for user dfbe23f3a0294148a88f4758d8470665 and project eac4a6151fbb44d1b0b61636a97f56b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:09:56.850296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:09:56.852671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:09:56.905654 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5140d2b3-5a41-47e9-8e12-d93a08be92ef tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689185 May 26 18:09:56.906348 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 306/572] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:09:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:09:56.918024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cd10c896-9798-4c0a-9805-9d18c979b4d2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:56.918699 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd10c896-9798-4c0a-9805-9d18c979b4d2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:57.000907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cd10c896-9798-4c0a-9805-9d18c979b4d2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:57.014614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cd10c896-9798-4c0a-9805-9d18c979b4d2 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1241 microversion: 2.1 time: 0.101602 May 26 18:09:57.015411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 267/573] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:56 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:58.033225 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:58.033855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:58.041218 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:58.041772 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:58.042652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:58.043096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:58.135144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:58.149465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-943cae5b-33c0-4360-b9f4-a48b1c6c1e42 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1293 microversion: 2.1 time: 0.120544 May 26 18:09:58.151317 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 307/574] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:58 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:59.173050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:59.175434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:59.186973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:59.187416 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:59.188233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:59.188674 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:59.192194 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:59.434185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:59.442422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fce6cb04-27cd-4b92-b980-cc1f08dd24e3 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.277280 May 26 18:09:59.443039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 268/575] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:09:59 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:00.090039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-e1e89c53-de0b-4d02-8744-15fa1dd2e99c req-9c433fdd-ed04-4aa0-9be0-db92fb363138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6393ca-e79a-4107-a73a-898478bef760", "tag": "fea0ab1f-60c8-4b9a-90be-c179c7c0c781"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:00.113234 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e1e89c53-de0b-4d02-8744-15fa1dd2e99c req-9c433fdd-ed04-4aa0-9be0-db92fb363138 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:00.113493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e1e89c53-de0b-4d02-8744-15fa1dd2e99c req-9c433fdd-ed04-4aa0-9be0-db92fb363138 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:00.126444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-e1e89c53-de0b-4d02-8744-15fa1dd2e99c req-9c433fdd-ed04-4aa0-9be0-db92fb363138 service nova] Creating event network-changed:fea0ab1f-60c8-4b9a-90be-c179c7c0c781 for instance ee6393ca-e79a-4107-a73a-898478bef760 on hv-cinder-83906 May 26 18:10:00.132725 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-e1e89c53-de0b-4d02-8744-15fa1dd2e99c req-9c433fdd-ed04-4aa0-9be0-db92fb363138 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052458 May 26 18:10:00.133344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 308/576] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:00.462973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:00.464336 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:00.472106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:00.472605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:00.473518 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:00.474019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:00.696894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:00.705720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-502df11f-fd0b-436a-8663-8ec562d58d17 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.246874 May 26 18:10:00.706335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 269/577] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:00 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:01.648850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:01.649847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:01.657302 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.657779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.658680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.659122 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.690594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-af2a2e80-0496-4b12-ae18-cf96186d1dd2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046368 May 26 18:10:01.691173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 309/578] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:01 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:10:01.723293 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:01.724206 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:01.731754 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.732209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.733136 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.733586 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.754507 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:01.754873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:01.762079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.762562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.763339 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.763779 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.793819 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:01.911873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f159fc2c-b99a-43ca-89fc-12a97cc81dfe tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 204 len: 0 microversion: 2.1 time: 0.161030 May 26 18:10:01.912618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 310/579] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:01 2022] DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:10:01.921872 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:01.922651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:01.929652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.930110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.931025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.931468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.980735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:01.989330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c571f593-0da6-49cf-aee8-951f36173cbd tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.269643 May 26 18:10:01.989956 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 270/580] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:01 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:02.092616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:02.101256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d64d3ea-d135-4ed2-b3a4-df7f4878ee09 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1675 microversion: 2.1 time: 0.183710 May 26 18:10:02.101844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 311/581] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:01 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:03.007587 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:03.008183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:03.015487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:03.015940 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:03.016725 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:03.017172 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:03.127503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:03.130009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:03.153049 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:03.153654 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:03.154983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:03.155558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:03.199142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:03.208365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-821a2af7-19da-49ca-8292-199a88cc3c74 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.204576 May 26 18:10:03.208972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 271/582] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:03 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:03.311241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:03.318905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ede5d6d-cc88-4424-b5ca-6b823aea100b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1675 microversion: 2.1 time: 0.201224 May 26 18:10:03.319493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 312/583] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:03 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:04.297859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:04.298788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:04.307721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.309884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.311360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.312129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.337292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:04.337920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:04.345477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.345929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.346754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.347197 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.553213 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:04.561544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-667cc9e1-93eb-4ff9-8e5b-1e0fb44d44c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1675 microversion: 2.1 time: 0.228093 May 26 18:10:04.566838 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 313/584] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:04 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:04.589364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:04.597734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-63260d2d-64db-4ae2-bc01-204ae4e7002d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.370199 May 26 18:10:04.598362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 272/585] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:04 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:05.341016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7703b2eb-1b34-4383-9595-28387f76d83a req-ad2bfb24-b2ea-4a50-be8b-793e7d16039c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8623e13-810b-433d-9e9d-e588bb5781eb", "name": "network-vif-deleted", "tag": "52f8b000-2834-4a6a-86b1-591ea06d67c9"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:05.346142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.354752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7703b2eb-1b34-4383-9595-28387f76d83a req-ad2bfb24-b2ea-4a50-be8b-793e7d16039c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.355206 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7703b2eb-1b34-4383-9595-28387f76d83a req-ad2bfb24-b2ea-4a50-be8b-793e7d16039c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.374631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7703b2eb-1b34-4383-9595-28387f76d83a req-ad2bfb24-b2ea-4a50-be8b-793e7d16039c service nova] Creating event network-vif-deleted:52f8b000-2834-4a6a-86b1-591ea06d67c9 for instance c8623e13-810b-433d-9e9d-e588bb5781eb on hv-cinder-83906 May 26 18:10:05.385920 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7703b2eb-1b34-4383-9595-28387f76d83a req-ad2bfb24-b2ea-4a50-be8b-793e7d16039c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048125 May 26 18:10:05.386996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 314/586] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:05.579707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:05.580343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:05.587689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.588160 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.588951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.589709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.621915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:05.622663 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:05.628168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.628720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.629254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lazy-loading 'fault' on Instance uuid c8623e13-810b-433d-9e9d-e588bb5781eb {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:05.631841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.633006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.633941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.634538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.677705 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:05.686344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d15cf8a6-635d-45a1-86c8-b5c9a57671c2 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 200 len: 1328 microversion: 2.1 time: 0.110951 May 26 18:10:05.686951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 273/587] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:05 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:05.784639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:05.793748 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-947df530-5008-4e46-a106-a6f4db76ca0d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.176779 May 26 18:10:05.794839 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 315/588] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:05 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:06.102180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-983e811f-335b-449d-81f3-cd40077721f8 req-e7d3a2fb-9f91-4913-a6aa-9c743abd49b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6393ca-e79a-4107-a73a-898478bef760", "name": "network-vif-plugged", "status": "completed", "tag": "fea0ab1f-60c8-4b9a-90be-c179c7c0c781"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:06.111318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-983e811f-335b-449d-81f3-cd40077721f8 req-e7d3a2fb-9f91-4913-a6aa-9c743abd49b7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.111791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-983e811f-335b-449d-81f3-cd40077721f8 req-e7d3a2fb-9f91-4913-a6aa-9c743abd49b7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.123787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-983e811f-335b-449d-81f3-cd40077721f8 req-e7d3a2fb-9f91-4913-a6aa-9c743abd49b7 service nova] Creating event network-vif-plugged:fea0ab1f-60c8-4b9a-90be-c179c7c0c781 for instance ee6393ca-e79a-4107-a73a-898478bef760 on hv-cinder-83906 May 26 18:10:06.129301 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-983e811f-335b-449d-81f3-cd40077721f8 req-e7d3a2fb-9f91-4913-a6aa-9c743abd49b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030738 May 26 18:10:06.130092 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 274/589] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:06.703850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:06.704611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:06.711908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.712362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.713736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.714316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.731245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb HTTP/1.1 May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:06.737247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:10:06.739534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'c8623e13-810b-433d-9e9d-e588bb5781eb'} May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:06.740695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:10:06.743260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:06.746239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:06.746239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e73f9a40-2882-4b72-b08f-34cf4227f6da tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 404 len: 111 microversion: 2.1 time: 0.039003 May 26 18:10:06.746239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 316/590] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:06 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:06.751225 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fb157b11-b647-41bf-b93f-ff6b4c3b624f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '.version_select at 0x7f1fa0293430>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:06.784242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fb157b11-b647-41bf-b93f-ff6b4c3b624f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927179739" status: 202 len: 0 microversion: 2.1 time: 0.038500 May 26 18:10:06.785097 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 275/591] 10.222.0.76 () {58 vars in 1220 bytes} [Thu May 26 18:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927179739 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:06.816992 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:06.818309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:06.829785 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:06.834615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.835499 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.837503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.838446 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.849651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:07.076520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:07.086542 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9e208c0-bf8b-4bbc-aaeb-53e3c28fff0e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.277647 May 26 18:10:07.089153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 317/592] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:06 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:07.591914 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:07.596031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-abbd7fa0-0bcd-40d4-a9fa-163c9afa580f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: .version_select at 0x7f1fa0216820>, body: {"keypair": {"name": "tempest-keypair-148660638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwv4bnHPM4ofczPzoym7M7WsFKNWvGx9Y7YfV0pfNuXvxCian85FkOivfLvHzL1v+ZVYE1NHEJFPSgAUkkw21JrO1As2q/BAZY3++4S8o1ZGCnRIyeIVfb7+gwLecI41g=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:07.613173 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-abbd7fa0-0bcd-40d4-a9fa-163c9afa580f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for project c0b976166b884524b9a3855712be72de. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:07.617700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-abbd7fa0-0bcd-40d4-a9fa-163c9afa580f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for user f6b5113ea0f4484ba91a5f0e6184ca35 and project c0b976166b884524b9a3855712be72de. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:07.643771 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-abbd7fa0-0bcd-40d4-a9fa-163c9afa580f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052556 May 26 18:10:07.644421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 276/593] 10.222.0.76 () {60 vars in 1158 bytes} [Thu May 26 18:10:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:08.112133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:08.114358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:08.127446 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:08.128280 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:08.129997 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:08.130993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:08.597538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:08.605906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfc87b3e-731a-4884-b281-08ccf91e7a5a tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1367 microversion: 2.1 time: 0.501967 May 26 18:10:08.606878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 318/594] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:08 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:09.453359 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-606215051", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31cac232-9768-4083-9065-c20228929068"}], "security_groups": [{"name": "tempest-securitygroup--1424905226"}], "key_name": "tempest-keypair-148660638", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:09.579753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] validate_networks() for [('31cac232-9768-4083-9065-c20228929068', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:10:09.632081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:09.632825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:09.640411 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.640681 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:09.641434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.641873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:09.821616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:09.831868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3c0f91f-11f8-4913-99fe-7812f27a05a9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1557 microversion: 2.1 time: 0.203187 May 26 18:10:09.832873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 319/595] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:09 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:09.863927 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:09.864837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:09.876801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.877596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:09.879131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.879929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:10.183183 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ef1b060d-08c1-436e-9472-9c2d7a79c822 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326927 May 26 18:10:10.183778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 320/596] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:10:09 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:10.475090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:10:10.475932 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:10:10.476605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:10:10.477259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:10:10.477804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:10:10.490071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:10.491002 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:10.491868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:10.492312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:10.513112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for project c0b976166b884524b9a3855712be72de. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:10.518897 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Getting quotas for user f6b5113ea0f4484ba91a5f0e6184ca35 and project c0b976166b884524b9a3855712be72de. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:10.534407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:10:10.536880 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:10:10.591375 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2e8da2d7-267b-4eab-a493-15091aa03c2e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.143120 May 26 18:10:10.593089 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 277/597] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:10:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:10:10.605868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c5644363-9490-4066-8aeb-8e13edc56981 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:10.606776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c5644363-9490-4066-8aeb-8e13edc56981 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:10.698585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c5644363-9490-4066-8aeb-8e13edc56981 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:10.708424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c5644363-9490-4066-8aeb-8e13edc56981 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1236 microversion: 2.1 time: 0.107241 May 26 18:10:10.709702 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 321/598] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:10 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:11.280049 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:11.281165 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:11.293129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.294059 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.295175 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.296003 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.397014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-72fff340-52b2-40f7-827b-b8cefed85889 req-cdc87ba7-1e3c-4854-9d86-0928698aba63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6393ca-e79a-4107-a73a-898478bef760", "tag": "fea0ab1f-60c8-4b9a-90be-c179c7c0c781"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:11.413437 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'services' on Instance uuid 3eceefa8-c466-4e82-b5b7-9458d4cd6775 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:11.417752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-72fff340-52b2-40f7-827b-b8cefed85889 req-cdc87ba7-1e3c-4854-9d86-0928698aba63 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.420414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-72fff340-52b2-40f7-827b-b8cefed85889 req-cdc87ba7-1e3c-4854-9d86-0928698aba63 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.444628 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-72fff340-52b2-40f7-827b-b8cefed85889 req-cdc87ba7-1e3c-4854-9d86-0928698aba63 service nova] Creating event network-changed:fea0ab1f-60c8-4b9a-90be-c179c7c0c781 for instance ee6393ca-e79a-4107-a73a-898478bef760 on hv-cinder-83906 May 26 18:10:11.453457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-72fff340-52b2-40f7-827b-b8cefed85889 req-cdc87ba7-1e3c-4854-9d86-0928698aba63 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063519 May 26 18:10:11.454304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 322/599] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:11.510887 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-317621f8-2cca-4ae2-9eea-4f8e522e0e1f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments/8d4869a1-a3a5-4364-8e74-4ad40e0ce102" status: 202 len: 0 microversion: 2.1 time: 0.239005 May 26 18:10:11.512338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 278/600] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:10:11 2022] DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments/8d4869a1-a3a5-4364-8e74-4ad40e0ce102 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:11.521760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:11.523192 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:11.532248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.532970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.533869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.534466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.569460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d560ead1-e782-4672-8d4e-28fe7e06a76f tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052675 May 26 18:10:11.570382 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 323/601] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:11 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:11.738098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:11.740084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:11.749697 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.750439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.751439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.752091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.848105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:11.864186 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-feac01a5-a31b-4189-aa7b-cd3091b83a7f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1288 microversion: 2.1 time: 0.134491 May 26 18:10:11.866056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 279/602] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:11 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:12.584176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:12.591587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:12.604487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.614329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:12.616247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.617423 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:12.679086 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc84bedf-e0ab-4f4c-8b23-74e4c64cf518 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098826 May 26 18:10:12.679677 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 324/603] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:12 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:12.890124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:12.892314 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:12.907904 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.909267 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:12.911080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.913123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.039917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:13.064320 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5ca6a81d-3708-4849-bb98-1b0cda7d8b1c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1294 microversion: 2.1 time: 0.182045 May 26 18:10:13.070291 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 280/604] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:12 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1294 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:13.697039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:13.698834 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:13.707787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.708493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.709935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.710766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.759773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:13.768730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3c4b4e6e-dd1f-4165-a5cd-4af5800d0968 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077189 May 26 18:10:13.769787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 325/605] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:13 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:10:13.851775 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:13.852756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:13.865436 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.866244 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.867395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.868599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.915024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:14.037909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-72862bcb-5f43-4595-8bd3-8fa8082fec74 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 204 len: 0 microversion: 2.1 time: 0.194226 May 26 18:10:14.043529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 281/606] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:13 2022] DELETE /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:10:14.053694 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:14.055394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:14.068099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.068847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.070180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.070975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.095484 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:14.096727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:14.109381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.110562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.112291 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.113018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.347870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:14.357927 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-608de698-459f-4d92-b987-d3e0cbed074d tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1689 microversion: 2.1 time: 0.311980 May 26 18:10:14.359240 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 326/607] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:14 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1689 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:14.406729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:14.415780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6c9d870b-ce40-47c8-b080-06be8e2f666a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.328407 May 26 18:10:14.419260 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 282/608] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:14 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:14.671790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-fbb957ca-fe2b-4263-89f3-96414faf148a req-2142cd16-588c-4813-b144-a24d8e95e15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80eb2910-b54f-4923-90f4-a5c99f742638", "tag": "d9b71324-5001-44e0-b552-2414d6973840"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:14.682354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fbb957ca-fe2b-4263-89f3-96414faf148a req-2142cd16-588c-4813-b144-a24d8e95e15e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.682619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fbb957ca-fe2b-4263-89f3-96414faf148a req-2142cd16-588c-4813-b144-a24d8e95e15e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.696670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-fbb957ca-fe2b-4263-89f3-96414faf148a req-2142cd16-588c-4813-b144-a24d8e95e15e service nova] Creating event network-changed:d9b71324-5001-44e0-b552-2414d6973840 for instance 80eb2910-b54f-4923-90f4-a5c99f742638 on hv-cinder-83906 May 26 18:10:14.702325 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-fbb957ca-fe2b-4263-89f3-96414faf148a req-2142cd16-588c-4813-b144-a24d8e95e15e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146682 May 26 18:10:14.703134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 327/609] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:15.177525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1077596327"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:15.178492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:15.186123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.186612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.187396 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.187832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.342489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.network.security_group_api [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Removing security group eea1309d-f568-4505-b38c-3ce75016ea77 from port e68fb5bc-371c-476f-9c1e-c7d20160dd7d May 26 18:10:15.385324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:15.386051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:15.392771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.393238 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.394038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.394580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.599826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:15.610005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c2a0199-87a1-4dcf-9c1a-3975ecc0d1e8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1689 microversion: 2.1 time: 0.230059 May 26 18:10:15.610674 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 328/610] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:15 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:15.616141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:15.616769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:15.623875 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.624349 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.625142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.625588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.810819 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:15.824634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ccd63cf7-028b-4a2e-9ce5-010d04c433d4 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.211916 May 26 18:10:15.825405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 329/611] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:15 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:15.873499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c706f035-55cc-4995-a1f5-044109989e25 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action" status: 202 len: 0 microversion: 2.1 time: 0.699536 May 26 18:10:15.876637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 283/612] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:10:15 2022] POST /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:16.640259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:16.641330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:16.648391 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.648970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:16.649849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.650901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:16.723248 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7897c8a0-da2e-4640-a968-6e5d9ce31d11 req-ef02ef79-71ce-4807-8b19-0e9546da6ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:16.736466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7897c8a0-da2e-4640-a968-6e5d9ce31d11 req-ef02ef79-71ce-4807-8b19-0e9546da6ddc service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.737150 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7897c8a0-da2e-4640-a968-6e5d9ce31d11 req-ef02ef79-71ce-4807-8b19-0e9546da6ddc service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:16.759140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7897c8a0-da2e-4640-a968-6e5d9ce31d11 req-ef02ef79-71ce-4807-8b19-0e9546da6ddc service nova] Creating event network-changed:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:10:16.768975 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7897c8a0-da2e-4640-a968-6e5d9ce31d11 req-ef02ef79-71ce-4807-8b19-0e9546da6ddc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049778 May 26 18:10:16.770429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 284/613] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:16.826054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:16.834604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0fd633bf-b1c2-42cd-87c0-5908403992ee tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1689 microversion: 2.1 time: 0.198276 May 26 18:10:16.835215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 330/614] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:16 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:16.853183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:16.855277 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:16.858624 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:16.869390 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.870263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:16.871715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.872504 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.232698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:17.247524 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-09066573-76c3-45fc-8dba-513a682e69cd tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.401834 May 26 18:10:17.248150 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 285/615] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:16 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:17.689053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:17.689799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:17.715532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:17.716802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.720315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:17.721548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.867822 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:17.868872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:17.890471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:17.901782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.904308 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:17.905411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.910235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lazy-loading 'services' on Instance uuid ac777d5f-b832-4aa7-ac43-5542d284cd38 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:17.965229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:18.079382 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-072f7714-0cb5-4a2b-9826-e81d3fa60440 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments/3d72453d-48dc-4761-a5a0-2f2ac1c66ac4" status: 202 len: 0 microversion: 2.1 time: 0.410956 May 26 18:10:18.087759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 331/616] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:10:17 2022] DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments/3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:18.102016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:18.104568 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:18.125993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.126853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.128331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.133503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.219531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f11d4dbf-8932-4381-800d-f55472ee9157 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127398 May 26 18:10:18.221000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 332/617] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:18 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:18.269565 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:18.270746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:18.295151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.295902 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.297291 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.298357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.492291 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:18.510696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7cde1736-b8a1-4a66-94d7-4da6bef8b321 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.247880 May 26 18:10:18.511800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 333/618] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:18 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:18.528242 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:18.537913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-97a16144-649c-458c-8ade-40aaebc619eb tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1689 microversion: 2.1 time: 0.678078 May 26 18:10:18.538944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 286/619] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:17 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1689 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:18.962462 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-616033c0-910a-4e65-9986-3c9756a7241f req-db0e1abb-e87e-4a12-9f92-06d03bab26ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:18.975077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-616033c0-910a-4e65-9986-3c9756a7241f req-db0e1abb-e87e-4a12-9f92-06d03bab26ad service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.975928 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-616033c0-910a-4e65-9986-3c9756a7241f req-db0e1abb-e87e-4a12-9f92-06d03bab26ad service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.996417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-616033c0-910a-4e65-9986-3c9756a7241f req-db0e1abb-e87e-4a12-9f92-06d03bab26ad service nova] Creating event network-changed:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:10:19.011832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-616033c0-910a-4e65-9986-3c9756a7241f req-db0e1abb-e87e-4a12-9f92-06d03bab26ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049897 May 26 18:10:19.013846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 334/620] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:19.239353 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.242252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.266107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.266781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.268228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.268998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.336729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f7eb4a8-12c7-4a7f-8a1b-651cdd963d9d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103910 May 26 18:10:19.338280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 287/621] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:10:19.354038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.355153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.367826 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.368567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.370714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.371372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.496636 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] HTTP exception thrown: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 is not attached to volume 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Request method failure captured: May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments/3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 HTTP/1.1 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8HhLVGoyHy7Lv_fKydhJUzNV-PU0nsp1jbIB7ECy5ayRN-r3bwsuOIHiUsJ8nAY3hRJSNQ4OyVZMbx-sSE1fNwS2iXe2pPZA3QGUMlfdcDZfAt1rmIq1dNGyxqvRRSJT0bjktUd9u3uUvssFMXo42abX7haKVhkmRFJH-qp5xIHX7s May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 98761773ea78490baebe0b3d9414ac45 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:19.503071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_98761773ea78490baebe0b3d9414ac45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 98761773ea78490baebe0b3d9414ac45 May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-TestMinimumBasicScenario-703601138-project May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: c02d672b8b864940a57d9954fa44c6b2 May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestMinimumBasicScenario-703601138-project May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:19.505662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 is not attached to volume 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'ac777d5f-b832-4aa7-ac43-5542d284cd38', 'id': '3d72453d-48dc-4761-a5a0-2f2ac1c66ac4'} May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4. May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:19.518466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 is not attached to volume 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 is not attached to volume 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:19.521915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Returning 404 to user: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 is not attached to volume 3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:19.523058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-300398b4-1751-4be2-8161-1ac47f3c8664 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments/3d72453d-48dc-4761-a5a0-2f2ac1c66ac4" status: 404 len: 154 microversion: 2.1 time: 0.156300 May 26 18:10:19.523058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 335/622] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:10:19 2022] DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38/os-volume_attachments/3d72453d-48dc-4761-a5a0-2f2ac1c66ac4 => generated 154 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:10:19.530250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.531148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.542512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.543828 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.544951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.546121 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.555114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.555888 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.567365 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.567979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.569403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.570215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.670791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:19.679455 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-96cc2a38-a9d3-4061-837f-6c200677f796 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1621 microversion: 2.1 time: 0.128699 May 26 18:10:19.680374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 336/623] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1621 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:19.855478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:19.863941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-372b7df6-5126-40f2-a0b1-ac16940d938b tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.338925 May 26 18:10:19.866756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 288/624] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:20.704001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:20.705107 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:20.709563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.720426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.721274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.723016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.723511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.762968 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:20.763945 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:20.767195 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.768387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=10 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.779287 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.780106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.781276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.781893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.785812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.786542 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.787394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'fault' on Instance uuid 3eceefa8-c466-4e82-b5b7-9458d4cd6775 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:20.832036 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:20.856791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:20.878838 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b341fc54-c1b6-4f0c-84b5-f957f435fb10 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 200 len: 1334 microversion: 2.1 time: 0.183276 May 26 18:10:20.881392 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 337/625] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:20 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 1334 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:20.901923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:20.903178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:20.927985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.929322 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.930912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.931713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.069783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8578a451-55a6-4ff8-9da6-13db2d5622e4 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 204 len: 0 microversion: 2.1 time: 0.312778 May 26 18:10:21.076037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 289/626] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:20 2022] DELETE /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:10:21.089370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-e13e178c-e301-42da-9d2b-e5d94efdd2b9 req-e4b1ce93-b5b0-49d9-9483-8aab9ef7b9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eceefa8-c466-4e82-b5b7-9458d4cd6775", "name": "network-vif-deleted", "tag": "5504205b-c7f9-44bd-bd92-7e2d2536ea96"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:21.107591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e13e178c-e301-42da-9d2b-e5d94efdd2b9 req-e4b1ce93-b5b0-49d9-9483-8aab9ef7b9a5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.109154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e13e178c-e301-42da-9d2b-e5d94efdd2b9 req-e4b1ce93-b5b0-49d9-9483-8aab9ef7b9a5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.138638 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-e13e178c-e301-42da-9d2b-e5d94efdd2b9 req-e4b1ce93-b5b0-49d9-9483-8aab9ef7b9a5 service nova] Creating event network-vif-deleted:5504205b-c7f9-44bd-bd92-7e2d2536ea96 for instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 on hv-cinder-83906 May 26 18:10:21.162534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-e13e178c-e301-42da-9d2b-e5d94efdd2b9 req-e4b1ce93-b5b0-49d9-9483-8aab9ef7b9a5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083176 May 26 18:10:21.167363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 290/627] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:21.183044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:21.185837 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:21.200213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.201085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.201688 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:21.202564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.203707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.211077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d83efc4-be2d-49f6-b139-bb343a32d823 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.327813 May 26 18:10:21.211670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 338/628] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:20 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:21.417695 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:21.433664 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25b9c72c-a560-42aa-b5c1-f32f85612f68 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1551 microversion: 2.1 time: 0.262223 May 26 18:10:21.434869 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 291/629] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:21 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1551 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:21.910249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:21.911176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: 3eceefa8-c466-4e82-b5b7-9458d4cd6775] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:21.922960 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.923496 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.924352 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.925084 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.951393 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] HTTP exception thrown: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Request method failure captured: May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 HTTP/1.1 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FP-eQmwCVvErdsoZ2kdT4qUsb86lF3Tz1lSgt3fZPaSuKQ5DbcnASrdG6Ld_I0wPlhDSwdF5Gc8u_HrJ_43tU9wFSPrsrQHa8WTSGhh4QwT894Nk4R5qJGRjKDFTwKwHYRkJx-NBt8Hdx_JQSmweFz7eHMXOgr58XUGkQbwOl5lOE May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:21.954802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 61f6dbd4328e459eb7d4f029551648bb May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. May 26 18:10:21.956918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '3eceefa8-c466-4e82-b5b7-9458d4cd6775'} May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:21.958346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. May 26 18:10:21.960140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:21.962297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Returning 404 to user: Instance 3eceefa8-c466-4e82-b5b7-9458d4cd6775 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:21.962297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8bf6a954-8526-4b70-84a1-ed61dd6ed174 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775" status: 404 len: 111 microversion: 2.1 time: 0.053016 May 26 18:10:21.962297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 339/630] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:21 2022] GET /compute/v2.1/servers/3eceefa8-c466-4e82-b5b7-9458d4cd6775 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:21.967976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7fb4b341-fe2c-495f-ad22-c2a4cfd7d4d5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '.version_select at 0x7f1fa0216670>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:21.988638 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7fb4b341-fe2c-495f-ad22-c2a4cfd7d4d5 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126842743" status: 202 len: 0 microversion: 2.1 time: 0.026801 May 26 18:10:21.989213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 292/631] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 26 18:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126842743 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:22.233485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:22.234130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:22.240827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:22.241278 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:22.242216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:22.242662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:22.459702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:22.460607 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:22.468283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:22.468739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:22.469547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:22.470024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:22.495343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:22.502688 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cb42c1fc-edb9-4cb7-82fc-a4572d084f28 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.274007 May 26 18:10:22.503473 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 340/632] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:22 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:22.700090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:22.708532 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cdd61bcb-1ddb-4e34-813c-921ab39c9061 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1551 microversion: 2.1 time: 0.252842 May 26 18:10:22.709248 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 293/633] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:22 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1551 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:23.531481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:23.532757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:23.544304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:23.545109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:23.546639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:23.547440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:23.678642 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-057d12f4-45a6-46e2-a96a-88de4bf300df req-304cbf54-42a0-4e00-bd9f-56b76700ba6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac777d5f-b832-4aa7-ac43-5542d284cd38", "name": "network-vif-deleted", "tag": "e68fb5bc-371c-476f-9c1e-c7d20160dd7d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:23.689551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-057d12f4-45a6-46e2-a96a-88de4bf300df req-304cbf54-42a0-4e00-bd9f-56b76700ba6c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:23.690008 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-057d12f4-45a6-46e2-a96a-88de4bf300df req-304cbf54-42a0-4e00-bd9f-56b76700ba6c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:23.712312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-057d12f4-45a6-46e2-a96a-88de4bf300df req-304cbf54-42a0-4e00-bd9f-56b76700ba6c service nova] Creating event network-vif-deleted:e68fb5bc-371c-476f-9c1e-c7d20160dd7d for instance ac777d5f-b832-4aa7-ac43-5542d284cd38 on hv-cinder-83906 May 26 18:10:23.724133 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-057d12f4-45a6-46e2-a96a-88de4bf300df req-304cbf54-42a0-4e00-bd9f-56b76700ba6c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048605 May 26 18:10:23.725594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 294/634] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:23.737593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:23.738908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:23.754184 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:23.754997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:23.756471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:23.757233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:23.766666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:23.779714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-10e893e1-318f-4c65-b23d-5c88a75b1b40 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.255204 May 26 18:10:23.780781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 341/635] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:23 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:23.847788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d672b8b864940a57d9954fa44c6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98761773ea78490baebe0b3d9414ac45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:23.861646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2d074c80-18ac-400d-b9e3-52ec741bfc2e tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 200 len: 1342 microversion: 2.1 time: 0.132862 May 26 18:10:23.863321 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 295/636] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:23 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 1342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:24.806838 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:24.807618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:24.814695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:24.815166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:24.816043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:24.816472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:24.888033 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:24.888934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] [instance: ac777d5f-b832-4aa7-ac43-5542d284cd38] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:24.897245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:24.897763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:24.898854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:24.899349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:24.917646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] HTTP exception thrown: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Request method failure captured: May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 HTTP/1.1 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8HhLVGoyHy7Lv_fKydhJUzNV-PU0nsp1jbIB7ECy5ayRN-r3bwsuOIHiUsJ8nAY3hRJSNQ4OyVZMbx-sSE1fNwS2iXe2pPZA3QGUMlfdcDZfAt1rmIq1dNGyxqvRRSJT0bjktUd9u3uUvssFMXo42abX7haKVhkmRFJH-qp5xIHX7s May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 98761773ea78490baebe0b3d9414ac45 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:10:24.919457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/98761773ea78490baebe0b3d9414ac45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_98761773ea78490baebe0b3d9414ac45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 98761773ea78490baebe0b3d9414ac45 May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestMinimumBasicScenario-703601138 May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-TestMinimumBasicScenario-703601138-project May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: c02d672b8b864940a57d9954fa44c6b2 May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestMinimumBasicScenario-703601138-project May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. May 26 18:10:24.922057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ac777d5f-b832-4aa7-ac43-5542d284cd38'} May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:24.923501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. May 26 18:10:24.925707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:10:24.927787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Returning 404 to user: Instance ac777d5f-b832-4aa7-ac43-5542d284cd38 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:24.927787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-24a056bb-9f0b-4a4c-b712-a37866b2d66d tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38" status: 404 len: 111 microversion: 2.1 time: 0.038063 May 26 18:10:24.927787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 296/637] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:24 2022] GET /compute/v2.1/servers/ac777d5f-b832-4aa7-ac43-5542d284cd38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:10:24.937364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-92cfa812-b8e3-4c27-a735-ed8515b59812 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] Calling method '.version_select at 0x7f1fa028b940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:24.968852 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-92cfa812-b8e3-4c27-a735-ed8515b59812 tempest-TestMinimumBasicScenario-703601138 tempest-TestMinimumBasicScenario-703601138-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-971143219" status: 202 len: 0 microversion: 2.1 time: 0.039912 May 26 18:10:24.969938 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 297/638] 10.222.0.76 () {58 vars in 1268 bytes} [Thu May 26 18:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-971143219 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:25.179865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:25.180751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:25.195126 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:25.195796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:25.197010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:25.197818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:25.252792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:25.320487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:25.334358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52aa4084-113c-41cb-a7a4-912accd0eb79 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.531654 May 26 18:10:25.335896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 342/639] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:24 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:25.412006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-be26ae48-727c-4de4-a4b8-9403e25d93f6 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 204 len: 0 microversion: 2.1 time: 0.240251 May 26 18:10:25.412743 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 298/640] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:25 2022] DELETE /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:10:25.427996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:25.429000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:25.440699 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:25.441457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:25.443038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:25.443819 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:25.463565 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:25.672476 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:25.682514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03e7decf-0892-48e3-91b3-4aaa5cb07cf8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1507 microversion: 2.1 time: 0.263498 May 26 18:10:25.683249 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 343/641] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:25 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:26.141056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-f3f69ce2-0c3a-4afa-9878-25329eb56a44 req-0c645859-475a-47f8-b3ad-78d9726068f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb2910-b54f-4923-90f4-a5c99f742638", "name": "network-vif-plugged", "status": "completed", "tag": "d9b71324-5001-44e0-b552-2414d6973840"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:26.151507 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f3f69ce2-0c3a-4afa-9878-25329eb56a44 req-0c645859-475a-47f8-b3ad-78d9726068f8 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:26.151961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f3f69ce2-0c3a-4afa-9878-25329eb56a44 req-0c645859-475a-47f8-b3ad-78d9726068f8 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:26.164502 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-f3f69ce2-0c3a-4afa-9878-25329eb56a44 req-0c645859-475a-47f8-b3ad-78d9726068f8 service nova] Creating event network-vif-plugged:d9b71324-5001-44e0-b552-2414d6973840 for instance 80eb2910-b54f-4923-90f4-a5c99f742638 on hv-cinder-83906 May 26 18:10:26.170845 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-f3f69ce2-0c3a-4afa-9878-25329eb56a44 req-0c645859-475a-47f8-b3ad-78d9726068f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139902 May 26 18:10:26.171746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 299/642] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:26.358482 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:26.359466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:26.366102 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:26.366592 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:26.367381 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:26.367817 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:26.705245 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:26.705950 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:26.713236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:26.713684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:26.714537 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:26.714979 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:26.739517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:26.750943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-36233d05-8871-449a-8f5f-762e1ab80d3c tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.397350 May 26 18:10:26.761756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 344/643] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:26 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:26.871938 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:26.885619 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc3db646-65b2-4604-b4b4-7396abaeaac4 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1507 microversion: 2.1 time: 0.183545 May 26 18:10:26.887283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 300/644] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:26 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:27.773340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:27.774508 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:27.786730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:27.787536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:27.788976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:27.789764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:27.911029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:27.913700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:27.936798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:27.939380 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:27.941141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:27.942168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:28.115832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:28.129098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a3d93c5-362c-41a4-8db9-dcc12effff25 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.363634 May 26 18:10:28.142754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 345/645] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:27 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:28.358381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:28.378263 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dcce6486-5fef-4cec-a5e0-a3adbde421f8 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1507 microversion: 2.1 time: 0.477155 May 26 18:10:28.381638 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 301/646] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:27 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:28.844309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-67391299-6aba-4212-b361-e4a61770e183 req-5a53925c-7df5-44f4-8ab6-70016c87f27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6004051-2831-4f2d-a998-0e4c56354f34", "name": "network-vif-deleted", "tag": "25a14006-975e-4a8e-9d3d-96f25c4467f0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:28.857331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-67391299-6aba-4212-b361-e4a61770e183 req-5a53925c-7df5-44f4-8ab6-70016c87f27a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:28.859033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-67391299-6aba-4212-b361-e4a61770e183 req-5a53925c-7df5-44f4-8ab6-70016c87f27a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:28.873340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-67391299-6aba-4212-b361-e4a61770e183 req-5a53925c-7df5-44f4-8ab6-70016c87f27a service nova] Creating event network-vif-deleted:25a14006-975e-4a8e-9d3d-96f25c4467f0 for instance e6004051-2831-4f2d-a998-0e4c56354f34 on hv-cinder-83906 May 26 18:10:28.879445 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-67391299-6aba-4212-b361-e4a61770e183 req-5a53925c-7df5-44f4-8ab6-70016c87f27a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 May 26 18:10:28.880460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 346/647] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:29.153408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:29.156725 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:29.173357 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.174180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.175053 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.175742 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.408578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:29.409394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:29.417297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.417975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.419198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.419795 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.430578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:29.445943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-661f808b-5999-4257-9766-583f86c5b9fc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1362 microversion: 2.1 time: 0.300096 May 26 18:10:29.447977 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 302/648] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:29 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:29.459241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.459583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.460056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'fault' on Instance uuid e6004051-2831-4f2d-a998-0e4c56354f34 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:29.548075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:29.575952 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a22fb765-d232-47db-a157-deb1c6ecb7e9 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 200 len: 1311 microversion: 2.1 time: 0.171530 May 26 18:10:29.578549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 347/649] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:29 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:30.474575 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:30.475369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.486289 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.487066 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.488424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.489311 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.604386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:30.605739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: e6004051-2831-4f2d-a998-0e4c56354f34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.624031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.626341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.628355 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.629404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.677868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] HTTP exception thrown: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Request method failure captured: May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 HTTP/1.1 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FP-eQmwCVvErdsoZ2kdT4qUsb86lF3Tz1lSgt3fZPaSuKQ5DbcnASrdG6Ld_I0wPlhDSwdF5Gc8u_HrJ_43tU9wFSPrsrQHa8WTSGhh4QwT894Nk4R5qJGRjKDFTwKwHYRkJx-NBt8Hdx_JQSmweFz7eHMXOgr58XUGkQbwOl5lOE May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:30.680054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 61f6dbd4328e459eb7d4f029551648bb May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. May 26 18:10:30.681722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'e6004051-2831-4f2d-a998-0e4c56354f34'} May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:30.682802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. May 26 18:10:30.684154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:30.686544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Returning 404 to user: Instance e6004051-2831-4f2d-a998-0e4c56354f34 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:30.687648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-98c9a215-ab2c-4993-87ec-fb76b209a767 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34" status: 404 len: 111 microversion: 2.1 time: 0.093650 May 26 18:10:30.688403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 348/650] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:30 2022] GET /compute/v2.1/servers/e6004051-2831-4f2d-a998-0e4c56354f34 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:10:30.700211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:30.700745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.710591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.711063 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.711889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.712347 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.744680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:30.752334 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:30.755335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79982382-4aad-4d7c-be51-0cd91b81dc91 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1548 microversion: 2.1 time: 0.285713 May 26 18:10:30.756376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 303/651] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:30 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1548 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:30.779772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:30.780430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.788298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.789327 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.790364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.791153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.837156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:30.876418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69aad679-1516-4fff-8f15-29c09677da6b tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 204 len: 0 microversion: 2.1 time: 0.179811 May 26 18:10:30.878043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 349/652] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:30 2022] DELETE /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:10:30.900666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:30.902437 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.914429 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.915302 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.917477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.926432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.982094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d3714123-187a-4f10-adcd-b053990e909a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210387 May 26 18:10:30.982821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 304/653] 10.222.0.76 () {58 vars in 1274 bytes} [Thu May 26 18:10:30 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:31.541992 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:31.553173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-86f9a948-80c5-4dcf-bcd6-506952dccbed tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.668580 May 26 18:10:31.553755 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 350/654] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:30 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:32.368229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-92be10f3-abb3-4840-99c9-490004a3fd4d req-f91dd01b-8f87-45e1-9cbc-0eb9fa5034cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80eb2910-b54f-4923-90f4-a5c99f742638", "tag": "d9b71324-5001-44e0-b552-2414d6973840"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:32.379204 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-92be10f3-abb3-4840-99c9-490004a3fd4d req-f91dd01b-8f87-45e1-9cbc-0eb9fa5034cf service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.381129 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-92be10f3-abb3-4840-99c9-490004a3fd4d req-f91dd01b-8f87-45e1-9cbc-0eb9fa5034cf service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.399464 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-92be10f3-abb3-4840-99c9-490004a3fd4d req-f91dd01b-8f87-45e1-9cbc-0eb9fa5034cf service nova] Creating event network-changed:d9b71324-5001-44e0-b552-2414d6973840 for instance 80eb2910-b54f-4923-90f4-a5c99f742638 on hv-cinder-83906 May 26 18:10:32.412054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-92be10f3-abb3-4840-99c9-490004a3fd4d req-f91dd01b-8f87-45e1-9cbc-0eb9fa5034cf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047100 May 26 18:10:32.412802 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 305/655] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:32.583307 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:32.585804 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:32.606648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.607730 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.609227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.610107 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.855133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:32.870215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca8aa266-3627-42ea-b557-0406a8c300de tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.291816 May 26 18:10:32.871451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 351/656] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:32 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:33.889952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:33.890716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:33.912154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:33.912568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:33.913313 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:33.913760 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:34.408234 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:34.434048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-efc6428f-5b36-48de-bc6e-4afe60ab32d0 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1521 microversion: 2.1 time: 0.548904 May 26 18:10:34.437224 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 306/657] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:33 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:34.713626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ed1940c0-f82e-4371-8b5d-6e760c1f201d req-dfb56075-d57a-4593-888c-d481b61bfb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e2e233-cbae-48e1-aa0e-cfc0231e18b3", "name": "network-vif-deleted", "tag": "c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:34.723274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ed1940c0-f82e-4371-8b5d-6e760c1f201d req-dfb56075-d57a-4593-888c-d481b61bfb9a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:34.723732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ed1940c0-f82e-4371-8b5d-6e760c1f201d req-dfb56075-d57a-4593-888c-d481b61bfb9a service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:34.738921 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ed1940c0-f82e-4371-8b5d-6e760c1f201d req-dfb56075-d57a-4593-888c-d481b61bfb9a service nova] Creating event network-vif-deleted:c84c0a7b-1b6a-4dd5-a9e2-2ac2f3be5bbb for instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 on hv-cinder-83906 May 26 18:10:34.745510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ed1940c0-f82e-4371-8b5d-6e760c1f201d req-dfb56075-d57a-4593-888c-d481b61bfb9a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 May 26 18:10:34.746465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 352/658] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:35.249000 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:35.251321 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:35.280491 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.282543 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.308798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.315581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.429282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:35.471752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:35.473529 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:35.496751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.506398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.508150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.512528 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.633520 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ebdb568e-d411-40c2-a59a-1beee652f925 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "DELETE /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 204 len: 0 microversion: 2.1 time: 0.397099 May 26 18:10:35.637567 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 307/659] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:10:35 2022] DELETE /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:10:35.639680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.640222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.640747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lazy-loading 'fault' on Instance uuid b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:35.643998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:35.645044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:35.653797 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.654599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.655529 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.656061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.710787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f6dbd4328e459eb7d4f029551648bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c49a9a21f1346a0bc8d774afc7951a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:35.736260 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5a9ec738-f90c-493e-937a-e95083e70a2a tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 200 len: 1311 microversion: 2.1 time: 0.272957 May 26 18:10:35.741078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 353/660] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:35 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 1311 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:35.858029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:35.866072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b73dad81-97d9-4b30-a52e-a6fa4a1c5b0b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1575 microversion: 2.1 time: 0.226884 May 26 18:10:35.866686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 308/661] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:35 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:36.758449 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:36.759085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] [instance: b7e2e233-cbae-48e1-aa0e-cfc0231e18b3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:36.763664 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:36.767517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.767937 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.768997 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.769600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.785814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] HTTP exception thrown: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Request method failure captured: May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 HTTP/1.1 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FP-eQmwCVvErdsoZ2kdT4qUsb86lF3Tz1lSgt3fZPaSuKQ5DbcnASrdG6Ld_I0wPlhDSwdF5Gc8u_HrJ_43tU9wFSPrsrQHa8WTSGhh4QwT894Nk4R5qJGRjKDFTwKwHYRkJx-NBt8Hdx_JQSmweFz7eHMXOgr58XUGkQbwOl5lOE May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:36.787705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8c49a9a21f1346a0bc8d774afc7951a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 8c49a9a21f1346a0bc8d774afc7951a2 May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1105521390 May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 61f6dbd4328e459eb7d4f029551648bb May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1105521390-project May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. May 26 18:10:36.789104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'b7e2e233-cbae-48e1-aa0e-cfc0231e18b3'} May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:36.789915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. May 26 18:10:36.791483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:36.793904 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] Returning 404 to user: Instance b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:36.794974 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-764b530f-3530-4ad2-8b4e-657009823794 tempest-ServerRescueNegativeTestJSON-1105521390 tempest-ServerRescueNegativeTestJSON-1105521390-project] 10.222.0.76 "GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3" status: 404 len: 111 microversion: 2.1 time: 0.040915 May 26 18:10:36.799052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 354/662] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:36 2022] GET /compute/v2.1/servers/b7e2e233-cbae-48e1-aa0e-cfc0231e18b3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:36.887135 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:36.887800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:36.895280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.896108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.897106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.897757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:37.097235 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:37.109160 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f782a5f-ce87-481b-8b05-f82303f4dc1b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1575 microversion: 2.1 time: 0.226344 May 26 18:10:37.110107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 309/663] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:36 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:38.128995 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:38.129635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:38.137655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:38.138241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:38.139158 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:38.139688 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:38.348597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:38.357093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-783c59ec-8369-4d71-9af2-063b78715872 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1575 microversion: 2.1 time: 0.233088 May 26 18:10:38.357681 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 355/664] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:38 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:39.375585 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:39.376890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:39.385268 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.385984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.386867 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.387322 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.550789 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:39.565159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5639d611-5c3b-4923-805e-f7d3f107d306 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1507 microversion: 2.1 time: 0.193487 May 26 18:10:39.566164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 310/665] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:39 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:39.686952 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1a6773d5-fdd9-428f-aae0-ab1f86e817ee req-dcb74ac0-fb4d-4d10-833f-f60fb76343b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6bb73-a942-4dbe-9a48-e5260f4955af", "name": "network-vif-deleted", "tag": "fd73efc2-2443-44e5-9d43-9649da06c136"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:39.710157 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1a6773d5-fdd9-428f-aae0-ab1f86e817ee req-dcb74ac0-fb4d-4d10-833f-f60fb76343b4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.711058 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1a6773d5-fdd9-428f-aae0-ab1f86e817ee req-dcb74ac0-fb4d-4d10-833f-f60fb76343b4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.725652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1a6773d5-fdd9-428f-aae0-ab1f86e817ee req-dcb74ac0-fb4d-4d10-833f-f60fb76343b4 service nova] Creating event network-vif-deleted:fd73efc2-2443-44e5-9d43-9649da06c136 for instance 68f6bb73-a942-4dbe-9a48-e5260f4955af on hv-cinder-83906 May 26 18:10:39.732020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1a6773d5-fdd9-428f-aae0-ab1f86e817ee req-dcb74ac0-fb4d-4d10-833f-f60fb76343b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050792 May 26 18:10:39.732944 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 356/666] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:40.584813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.585745 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.607252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.608038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.609302 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.610021 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.712169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.722029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.723234 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lazy-loading 'fault' on Instance uuid 68f6bb73-a942-4dbe-9a48-e5260f4955af {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:40.841281 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:40.850951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6015651c-220a-4c44-af2d-ad31552083ea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 200 len: 1182 microversion: 2.1 time: 0.270638 May 26 18:10:40.861552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 311/667] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:40 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 1182 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:41.870702 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:41.871489 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:41.879344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:41.879791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:41.880569 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:41.881007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:41.899498 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] HTTP exception thrown: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Request method failure captured: May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af HTTP/1.1 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8G82G1uHFHlMcc6TEzCtjvKciJb6NmnP1QDgi-Lbc5IcwGM7cJGG7-N6tIC8oyJJf-1-tF0oQYfs8UGm6f6CupkigQKNper5reqviBZs40y15Nrysrn4tm_pUxgDtqiSdtT4EuDD3WwWuJr70Zp_LSA6VHDpCcImZan9h33Ha90Jb0 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:10:41.903729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_45d94db7075c40cbae3f106a9661d969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-775328860 May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-775328860-project May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 42c96a85400941818b658cca8cb56fec May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-775328860-project May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:10:41.907311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '68f6bb73-a942-4dbe-9a48-e5260f4955af'} May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:41.908514 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:10:41.911009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:10:41.913749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Returning 404 to user: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:41.913749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d686a8d9-aeee-4642-a0e8-c50447504ff7 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 404 len: 111 microversion: 2.1 time: 0.040164 May 26 18:10:41.913749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 357/668] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:41 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:42.080606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761140541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-17761177", "security_groups": [{"name": "tempest-secgroup-smoke-1733973357"}], "block_device_mapping_v2": [{"uuid": "f88acdd8-9bcc-4973-bc88-e8118ca40107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ba39add-f4a7-4061-91a5-b356a25c19cf"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:42.316056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] validate_networks() for [('8ba39add-f4a7-4061-91a5-b356a25c19cf', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:10:43.018819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:10:43.019282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:10:43.019765 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:10:43.020180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:10:43.021029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:10:43.031384 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:43.031845 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:43.032646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:43.033085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:43.053493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:43.062794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for user 42c96a85400941818b658cca8cb56fec and project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:43.155151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:10:43.157868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f88acdd8-9bcc-4973-bc88-e8118ca40107',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:10:43.379084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-455eee27-70b1-4605-9c79-502c5f708f4f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.306605 May 26 18:10:43.380048 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 312/669] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:10:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:10:43.392746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d9046f6-c608-4844-b518-28b23d9361c1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:43.393463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d9046f6-c608-4844-b518-28b23d9361c1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:43.466002 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d9046f6-c608-4844-b518-28b23d9361c1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:43.483964 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d9046f6-c608-4844-b518-28b23d9361c1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1093 microversion: 2.1 time: 0.094646 May 26 18:10:43.500201 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 358/670] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:43 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1093 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:44.515326 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:44.516032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:44.525851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:44.526297 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:44.527464 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:44.527948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:44.636698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:44.651650 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8bf747cb-2f0d-4222-8a54-d167b83d9f6e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1135 microversion: 2.1 time: 0.142143 May 26 18:10:44.652511 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 313/671] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:44 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1135 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:45.676961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:45.678250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:45.687334 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:45.688034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:45.688823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:45.689264 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:45.780962 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:45.791808 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-840ce7c6-0598-489f-81c9-4f97fd373b3f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1209 microversion: 2.1 time: 0.119350 May 26 18:10:45.793083 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 359/672] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:45 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:46.811202 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:46.812777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:46.830974 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:46.834965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:46.836237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:46.836927 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.535846 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:47.544777 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-50403e1a-e981-4f9d-a9be-86d0dd936db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.739370 May 26 18:10:47.545328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 314/673] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:46 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:47.641765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:47.642505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:47.649753 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.651904 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.652736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.653366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.688316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lazy-loading 'flavor' on Instance uuid bc6e1044-c79a-4201-b31d-686b44516f55 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:47.787481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.799908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20bc5c7f-55b7-4e20-bd70-8b758176ffec tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "POST /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55/action" status: 202 len: 0 microversion: 2.1 time: 0.161598 May 26 18:10:47.801174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 360/674] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:10:47 2022] POST /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:10:47.812635 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.814407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:47.817941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.834007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.834845 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.836349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.836910 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.163749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:48.171634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d83394aa-8a14-49c0-8493-7be32ec6c7d7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.364815 May 26 18:10:48.172214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 315/675] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:48.564328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.565116 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:48.575825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:48.576287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.577781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:48.578257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.733781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:48.746250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-15c417f9-f49e-4816-84cd-fdcf1fc68495 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.186703 May 26 18:10:48.756304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 361/676] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:48.798519 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-c28fb711-77c9-4088-a58c-0cbce6304a30 req-208cffab-a851-4865-bb9e-7eba9ec5468e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d037f7b-7d2e-440e-9e58-917176fdd5f4", "tag": "0050fac2-27f6-43c1-9c41-168fb25746b5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:48.813972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c28fb711-77c9-4088-a58c-0cbce6304a30 req-208cffab-a851-4865-bb9e-7eba9ec5468e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:48.815312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c28fb711-77c9-4088-a58c-0cbce6304a30 req-208cffab-a851-4865-bb9e-7eba9ec5468e service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.836317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-c28fb711-77c9-4088-a58c-0cbce6304a30 req-208cffab-a851-4865-bb9e-7eba9ec5468e service nova] Creating event network-changed:0050fac2-27f6-43c1-9c41-168fb25746b5 for instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 on hv-cinder-83906 May 26 18:10:48.850659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-c28fb711-77c9-4088-a58c-0cbce6304a30 req-208cffab-a851-4865-bb9e-7eba9ec5468e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060622 May 26 18:10:48.857808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 316/677] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:49.191111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.192119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:49.199226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.199820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.200901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.201486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.350838 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.351923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:49.368006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:49.374408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.375432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.377045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.377906 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.379376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfacd8ab-3b71-40c7-88a2-b8898a75b6dc tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.191881 May 26 18:10:49.380888 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 362/678] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:49.420136 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8ce22cc-b36a-4a95-a8ef-89ca3f16c8a4 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/ips" status: 200 len: 148 microversion: 2.1 time: 0.076298 May 26 18:10:49.425962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 317/679] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/ips => generated 148 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:49.764559 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.765201 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:49.789091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.789967 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.791488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.792921 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.977602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:49.988261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-29df04ca-f4aa-40f3-b7f9-ed34a3babf42 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.228400 May 26 18:10:49.989387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 363/680] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:50.402506 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:50.403152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:50.416634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.417105 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:50.417928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.418412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:50.747007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:50.758102 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-85d08bce-6208-4984-858a-58d3a491c8e8 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.360878 May 26 18:10:50.758729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 318/681] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:50 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:50.861342 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0dd59e3-060a-4212-ba1d-765c8fd53f60"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:50.863204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:50.873848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.875168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:50.877631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.878451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.005309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:51.005931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:51.033183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:51.033456 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.040675 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:51.041289 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.225587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-56d17b16-620a-4b9c-a8de-f94d9da2b022 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "POST /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368418 May 26 18:10:51.230241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 364/682] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:10:50 2022] POST /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:51.359593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:51.367735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-46d13b7b-eb33-4302-8113-b15694f16331 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.366157 May 26 18:10:51.369153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 319/683] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:51 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:51.777535 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:51.778279 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:51.785951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:51.786539 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.787717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:51.788270 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.949829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:51.958982 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1fe48779-ec8c-418f-84f1-31a27c6edacd tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.187753 May 26 18:10:51.959600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 365/684] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:51 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:52.031643 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5b74c202-2b42-4052-9715-efcb05b1d251 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: .version_select at 0x7f1fa022ab80>, body: {"keypair": {"name": "tempest-keypair-964452170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlML1cRAVpWb1Qu3LJ4nic1b0pW3uf/P2wyN9WSurFJNyVvVn+tia5Sgs/b47+9TV34QtgecBKsihQHKWSzIT4pS7vy7oEoWz2IHHZG1meF1o3GpRNAnBpOAAg7EubjJQ=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:52.047653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-5b74c202-2b42-4052-9715-efcb05b1d251 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:52.051906 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-5b74c202-2b42-4052-9715-efcb05b1d251 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for user 1b262e67242c4384ba5bf0356a08679e and project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:52.075902 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5b74c202-2b42-4052-9715-efcb05b1d251 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.193522 May 26 18:10:52.076503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 320/685] 10.222.0.76 () {62 vars in 1199 bytes} [Thu May 26 18:10:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:10:52.386138 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:52.386863 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:52.393659 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.394109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.395520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.395520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.573459 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:52.582981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e53db2cc-e9dd-4c8a-9943-b5c1f9febbc1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.201241 May 26 18:10:52.583835 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 366/686] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:52 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:52.979479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:52.980546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:52.995432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.996156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.997971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.997971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:53.046497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:53.186774 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:53.200433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-784b2e1a-234a-476b-a5a6-804f741ad514 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.226811 May 26 18:10:53.201685 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 321/687] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:52 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:53.601253 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:53.601778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:53.605119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:53.611394 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:53.611833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:53.612647 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:53.613052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:53.651999 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1371035133", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb5c7d1-b856-499c-9d5b-edcdfcd226bf"}], "security_groups": [{"name": "tempest-securitygroup--422715605"}], "key_name": "tempest-keypair-964452170", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:53.765621 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] validate_networks() for [('bdb5c7d1-b856-499c-9d5b-edcdfcd226bf', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:10:53.773870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:53.782109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d444733-4395-4e93-b4ba-2459e809afce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.184675 May 26 18:10:53.782735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 367/688] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:53 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:54.208705 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:10:54.209218 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:10:54.209736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:10:54.210311 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:10:54.210801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:10:54.219504 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:54.220240 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:54.221190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.221719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.222654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.223169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.226901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.227471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.228494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.229015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.246413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:54.251311 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for user 1b262e67242c4384ba5bf0356a08679e and project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:54.264024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:10:54.266382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:10:54.325365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-836a5f47-6ae2-4eba-bc02-46de16e3c58c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.678672 May 26 18:10:54.327087 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 322/689] 10.222.0.76 () {62 vars in 1187 bytes} [Thu May 26 18:10:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 18:10:54.337761 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:54.339101 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:54.383893 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:54.394770 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-655c24cb-de25-40ec-8565-7356ef66ae17 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.179117 May 26 18:10:54.405477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 368/690] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:54 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:54.415688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:54.437799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:54.440763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:54.442024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a843e587-1b20-49d5-b743-84667bb98b3d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1281 microversion: 2.20 time: 0.108843 May 26 18:10:54.453918 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 323/691] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:10:54 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:10:54.800585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:54.801069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:54.817150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.817880 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.818741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.819304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.997802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.007475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0879e8b4-ab4b-4378-8a5d-6f2166c450ce tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.211553 May 26 18:10:55.008127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 369/692] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:54 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:55.412498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.413037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:55.420307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.420755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.421522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.421964 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.437890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.461034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.461651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:55.468421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.468870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.469641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.470078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.555267 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.565009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.566680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.567745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-601751cd-cf21-47a3-ba31-1102045675f9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1333 microversion: 2.20 time: 0.110457 May 26 18:10:55.568246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 370/693] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:10:55.584578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5722bce4-2c1e-4db3-b7f9-7725907fa2bf tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.184218 May 26 18:10:55.593382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 324/694] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:56.025601 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.026587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.035500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.036009 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.036815 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.037282 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.192441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.203455 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0cfe10b3-829b-4cc0-809c-26e2515722bc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.183065 May 26 18:10:56.205579 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 371/695] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:56.587188 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.587951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.600412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.600972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.601824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.602290 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.610917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.612124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.619828 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.620642 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.621652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.622973 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.714008 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.733073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.734657 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.735857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-31f46ae5-165c-47e6-9c68-fcc9412cf0d6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1339 microversion: 2.20 time: 0.153008 May 26 18:10:56.736450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 325/696] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:56.777139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.785676 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5b74b46e-cae2-4e47-90de-3c8e5c748074 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.179548 May 26 18:10:56.786308 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 372/697] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:57.223534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.224065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:57.231067 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.231609 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.232395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.232832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.449953 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.460187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe6e6f31-1383-49a3-97a3-9319a4f8359b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.240403 May 26 18:10:57.460880 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 326/698] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:57.755906 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.758797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:57.772629 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.773594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.776486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.777660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.782211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-979ff66c-6875-4575-acd8-1f3ed3121277 req-29038329-530e-4695-a0dc-e8453c58d203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:57.809256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-979ff66c-6875-4575-acd8-1f3ed3121277 req-29038329-530e-4695-a0dc-e8453c58d203 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.809896 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-979ff66c-6875-4575-acd8-1f3ed3121277 req-29038329-530e-4695-a0dc-e8453c58d203 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.828108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-979ff66c-6875-4575-acd8-1f3ed3121277 req-29038329-530e-4695-a0dc-e8453c58d203 service nova] Creating event network-changed:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:10:57.843578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-979ff66c-6875-4575-acd8-1f3ed3121277 req-29038329-530e-4695-a0dc-e8453c58d203 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068456 May 26 18:10:57.844207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 327/699] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:57.855941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.856890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:57.878038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.878786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.879988 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.880644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.019137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.045032 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.046959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.049001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b5138ffa-456d-43a2-b314-99b8e2e01ed6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.298437 May 26 18:10:58.051180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 373/700] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:58.203001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.211331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-72ff6c9d-ccc7-4da0-a1f9-887774ea9baa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.365861 May 26 18:10:58.221973 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 328/701] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:58.479266 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:58.479964 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:58.486534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.486988 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.487765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.488212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.640204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.648163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52f21d7b-4908-4a45-90a2-42e91a36e3d8 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.173939 May 26 18:10:58.650252 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 374/702] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:58 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:58.929399 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:58.929934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:58.937573 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.938026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.938821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.939259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.044960 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'services' on Instance uuid ee6393ca-e79a-4107-a73a-898478bef760 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:59.068829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:59.069439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.076385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.076841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.077626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.078255 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.121985 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4b4beea3-d68e-412f-a6db-5196ea07b36e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments/d0dd59e3-060a-4212-ba1d-765c8fd53f60" status: 202 len: 0 microversion: 2.1 time: 0.196233 May 26 18:10:59.122959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 329/703] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:10:58 2022] DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments/d0dd59e3-060a-4212-ba1d-765c8fd53f60 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:59.132688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:59.134480 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.141880 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.142824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.143870 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.144569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.181540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ab5d335d-f910-4306-841e-9f16ad29142e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052924 May 26 18:10:59.182262 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 330/704] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:10:59 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:59.229712 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:59.230387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.232167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.237054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.237516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.238335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.238804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.240747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.242289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.244097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9f831d63-7bd6-403e-b178-d4461a5c4932 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.178559 May 26 18:10:59.244675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 375/705] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:10:59 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:10:59.377979 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.386489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-900da6f2-245f-4966-9921-c1d3b91b5090 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.161253 May 26 18:10:59.387073 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 331/706] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:59 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:59.669246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:59.670139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.676488 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.677771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.678630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.679280 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.684334 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:59.851064 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.858837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cae4f61e-c4d6-479f-91ca-7c2652d8d37a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.195279 May 26 18:10:59.859414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 376/707] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:10:59 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:00.151268 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-09dec460-eebe-426f-8539-c21c8b5d5566 req-faa0c820-c8fb-423f-b0c7-1c0a1472242b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d037f7b-7d2e-440e-9e58-917176fdd5f4", "name": "network-vif-plugged", "status": "completed", "tag": "0050fac2-27f6-43c1-9c41-168fb25746b5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:00.160432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-09dec460-eebe-426f-8539-c21c8b5d5566 req-faa0c820-c8fb-423f-b0c7-1c0a1472242b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.160947 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-09dec460-eebe-426f-8539-c21c8b5d5566 req-faa0c820-c8fb-423f-b0c7-1c0a1472242b service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.172568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-09dec460-eebe-426f-8539-c21c8b5d5566 req-faa0c820-c8fb-423f-b0c7-1c0a1472242b service nova] Creating event network-vif-plugged:0050fac2-27f6-43c1-9c41-168fb25746b5 for instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 on hv-cinder-83906 May 26 18:11:00.177209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-09dec460-eebe-426f-8539-c21c8b5d5566 req-faa0c820-c8fb-423f-b0c7-1c0a1472242b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 May 26 18:11:00.177825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 332/708] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:00.193139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:00.194226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:00.201940 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.202441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.203255 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.203737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.235729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3350989b-fcb1-4036-8d9c-1501584102da tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046425 May 26 18:11:00.236923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 377/709] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:00 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:00.263534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:00.264244 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:00.270553 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.271010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.271783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.272230 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.404168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:00.404839 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:00.405709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:00.411232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.411717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.412495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.412978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.413618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:00.415854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:00.417004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-35029c77-4a5b-4762-8032-75b3e1693732 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.158563 May 26 18:11:00.417572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 333/710] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:00 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:11:00.545446 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:00.553060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-618c835e-5d5c-44b2-a941-805eed7ad7b5 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.153308 May 26 18:11:00.553616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 378/711] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:00 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:00.875696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:00.876237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:00.882569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.883030 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.883857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.884829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.025756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:01.033726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c40a4b73-4874-4de6-bb59-0824c83e28fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.161949 May 26 18:11:01.034348 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 334/712] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:00 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:01.249128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:01.250150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:01.256887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.257345 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.258117 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.258654 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.289749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-270a4caa-d3e8-420f-a9e0-a5914b21910e tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 May 26 18:11:01.290894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 379/713] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:01 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:11:01.435912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:01.436526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:01.443572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.444043 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.444832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.445268 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.572990 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:01.573623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:01.580014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.580332 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.581115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:01.581547 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:01.590356 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:01.599950 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:01.601468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:01.603410 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a4039e53-43ba-4bed-84f4-2ae5163647ef tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.170902 May 26 18:11:01.603967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 335/714] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:01 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:01.741056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:01.750471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4ec6b7a-91e6-4f9a-be38-e9eb053b8477 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.182711 May 26 18:11:01.751109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 380/715] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:01 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:02.051847 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.053770 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.064503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.065661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.066354 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.067678 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.298640 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:02.302744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.303662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.307120 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f25a63d-397e-4b33-8f2a-82d0097a8e28 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.260040 May 26 18:11:02.307697 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 336/716] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:02 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:02.311562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.312019 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.312791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.313274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.344669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-40b2591e-9dce-4b11-b2a7-188ccef98df9 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045726 May 26 18:11:02.345242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 381/717] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:02 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:11:02.405868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.406417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.412545 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.412994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.413755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.414206 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.442006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:11:02.518697 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cd8c52bf-e57f-4fb7-980a-991aeaa3589c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 204 len: 0 microversion: 2.1 time: 0.116425 May 26 18:11:02.520005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 337/718] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:02 2022] DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:11:02.542840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.544445 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.557986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.558578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.559438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.560005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.622003 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.622866 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.633176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.633548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.634439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.636079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.711894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:02.720130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-28d6fdc8-7f85-4e94-941c-71ddd70fff41 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1680 microversion: 2.1 time: 0.189937 May 26 18:11:02.720716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 382/719] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:02 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:02.768983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:02.769516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:02.775641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.776203 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.776859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:02.777301 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:02.778693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:02.787076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:02.788630 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:02.789756 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b40b55b9-f348-4903-8b83-8a37a4b8f60d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.172605 May 26 18:11:02.790885 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 338/720] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:02 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:11:03.167652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.175194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-baef2d7e-d6a6-4ce3-9720-27f3a900c11e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.410192 May 26 18:11:03.175764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 383/721] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:02 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:03.324742 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:03.325354 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:03.331403 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.331855 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.332613 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.333055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.467422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.475442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9d20e9ec-58d4-449f-862a-13d0f9c75628 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.155097 May 26 18:11:03.476011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 339/722] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:03 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:03.737398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:03.738013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:03.744914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.745301 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.746060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.746528 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.808937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:03.809576 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:03.815616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.816069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.816862 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.817300 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.822361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:03.879812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.887870 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-927492b7-6f82-44b9-8b37-a8a42bfce74c tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1680 microversion: 2.1 time: 0.154259 May 26 18:11:03.888437 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 384/723] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:03 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:03.955739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.964669 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.966222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:03.967338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b89dda5a-0c2c-46d8-ae8f-1c49df41af00 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.162632 May 26 18:11:03.968545 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 340/724] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:03 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:11:04.192301 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.192919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.199483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.199935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.200714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.201157 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.238500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-de63709c-68ae-4efb-af77-dd8822d320dc req-e386e2a0-5de8-480f-a5d3-e712b4a3e109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "name": "network-vif-plugged", "status": "completed", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:04.243431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:04.250641 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-de63709c-68ae-4efb-af77-dd8822d320dc req-e386e2a0-5de8-480f-a5d3-e712b4a3e109 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.250965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-de63709c-68ae-4efb-af77-dd8822d320dc req-e386e2a0-5de8-480f-a5d3-e712b4a3e109 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.264034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-de63709c-68ae-4efb-af77-dd8822d320dc req-e386e2a0-5de8-480f-a5d3-e712b4a3e109 service nova] Creating event network-vif-plugged:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:11:04.269666 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-de63709c-68ae-4efb-af77-dd8822d320dc req-e386e2a0-5de8-480f-a5d3-e712b4a3e109 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 May 26 18:11:04.270817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 341/725] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:04.344931 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:04.355098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5a5bf572-405c-423f-8932-4dd7e06797be tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1568 microversion: 2.1 time: 0.166581 May 26 18:11:04.355778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 385/726] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:04.373111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:04.373767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.380095 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.380541 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.381336 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.381767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.424859 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=18 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:04.480641 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-97b968c6-74a9-4909-b242-d6ac041ec0f1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "POST /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55/action" status: 202 len: 0 microversion: 2.1 time: 0.112422 May 26 18:11:04.482004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 342/727] 10.222.0.76 () {60 vars in 1277 bytes} [Thu May 26 18:11:04 2022] POST /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:04.490380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.491023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.500763 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.501227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.502014 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.502494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.506168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.506571 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.515140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.515588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.516510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.516951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.672420 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:04.676090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:04.681614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afbd9611-c07a-4759-b736-a126355a3d01 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1576 microversion: 2.1 time: 0.194278 May 26 18:11:04.687197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-60e8ebaa-fa56-4dc0-967c-5de73da6a0e5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1265 microversion: 2.1 time: 0.189682 May 26 18:11:04.687991 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 343/728] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:04.691740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 386/729] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:04.905049 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.905679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.911555 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.912010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.912780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.913218 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.992087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.993888 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:05.001813 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.002321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.003570 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.004023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.098362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.109707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc59e37b-ee64-4d41-a2f5-5254ed855ed8 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1680 microversion: 2.1 time: 0.208239 May 26 18:11:05.111949 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 344/730] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:05.170369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.187630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.189250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.190635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-107177ec-d8b4-4912-99a1-03c88855e1af tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.205062 May 26 18:11:05.191275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 387/731] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:05.699994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:05.700681 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:05.705948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:05.706610 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:05.707698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.708203 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.709088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.709588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.715072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.715745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.716548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.716999 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.865915 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.873969 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd22e5a8-6ba9-4564-b480-3c93056a6dcc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1452 microversion: 2.1 time: 0.172914 May 26 18:11:05.874589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 388/732] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:05 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:05.890567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:05.891190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:05.897519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.897985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.898808 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:05.899989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:05.945552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:05.956623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-073e49bc-68cd-4e2d-a17a-5bff5713902a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1518 microversion: 2.1 time: 0.261500 May 26 18:11:05.962603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 345/733] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:05 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:06.052229 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.061765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c05586d7-6842-4921-98ee-c52b1e6d6813 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1452 microversion: 2.1 time: 0.174266 May 26 18:11:06.061980 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 389/734] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:05 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:06.128328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:06.129060 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:06.141503 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.142007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.142780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.143405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.208994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:06.210059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:06.217369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.218000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.218841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.219452 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.410400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.420349 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a8de3e5b-2727-426b-866e-0ffc87c72e28 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1680 microversion: 2.1 time: 0.295696 May 26 18:11:06.421655 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 346/735] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:06 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:06.427104 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-bb8e24e2-0bfb-4ca1-91ae-7c3d69bb67f0 req-00ab1221-fa79-4db8-92f2-a3bc8b9f4416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "name": "network-vif-unplugged", "status": "completed", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:06.432018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.438243 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-bb8e24e2-0bfb-4ca1-91ae-7c3d69bb67f0 req-00ab1221-fa79-4db8-92f2-a3bc8b9f4416 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.438783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-bb8e24e2-0bfb-4ca1-91ae-7c3d69bb67f0 req-00ab1221-fa79-4db8-92f2-a3bc8b9f4416 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.451749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.455734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.compute.server_external_events [req-bb8e24e2-0bfb-4ca1-91ae-7c3d69bb67f0 req-00ab1221-fa79-4db8-92f2-a3bc8b9f4416 service nova] Unable to find a host for instance bc6e1044-c79a-4201-b31d-686b44516f55. Dropping event network-vif-unplugged {{(pid=117833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 18:11:06.456763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-bb8e24e2-0bfb-4ca1-91ae-7c3d69bb67f0 req-00ab1221-fa79-4db8-92f2-a3bc8b9f4416 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033776 May 26 18:11:06.461027 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 347/736] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 18:11:06.463510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.465137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.466583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f101457c-a3be-46ff-bb09-f7bef50457b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1406 microversion: 2.20 time: 0.261512 May 26 18:11:06.467319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 390/737] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:06 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:11:06.738686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ecf08a19-4f5e-4f05-978f-6939429a73fe req-1622ab0c-7e0f-4dd4-8a2c-519e723287c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6393ca-e79a-4107-a73a-898478bef760", "name": "network-vif-deleted", "tag": "fea0ab1f-60c8-4b9a-90be-c179c7c0c781"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:06.752201 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ecf08a19-4f5e-4f05-978f-6939429a73fe req-1622ab0c-7e0f-4dd4-8a2c-519e723287c1 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.752548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ecf08a19-4f5e-4f05-978f-6939429a73fe req-1622ab0c-7e0f-4dd4-8a2c-519e723287c1 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.770625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ecf08a19-4f5e-4f05-978f-6939429a73fe req-1622ab0c-7e0f-4dd4-8a2c-519e723287c1 service nova] Creating event network-vif-deleted:fea0ab1f-60c8-4b9a-90be-c179c7c0c781 for instance ee6393ca-e79a-4107-a73a-898478bef760 on hv-cinder-83906 May 26 18:11:06.777198 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ecf08a19-4f5e-4f05-978f-6939429a73fe req-1622ab0c-7e0f-4dd4-8a2c-519e723287c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043004 May 26 18:11:06.778087 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 348/738] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:06.974818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:06.975746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:06.986925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.988489 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.990239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.990693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.253207 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:07.265444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1645d27a-b749-466b-9d52-4b88004bc830 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1518 microversion: 2.1 time: 0.294450 May 26 18:11:07.268099 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 391/739] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:06 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:07.439624 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:07.440505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:07.449283 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.450159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.451232 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.451890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.495631 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:07.497258 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:07.507951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.511173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.512372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.515294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.522911 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.523707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.524427 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lazy-loading 'fault' on Instance uuid ee6393ca-e79a-4107-a73a-898478bef760 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:11:07.586034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfbe23f3a0294148a88f4758d8470665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4a6151fbb44d1b0b61636a97f56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:07.596871 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47967043-d376-4962-b5c6-b487ae137fcb tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 200 len: 1331 microversion: 2.1 time: 0.161670 May 26 18:11:07.598232 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 349/740] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:07 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:07.767421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:07.770151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:07.779200 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:07.780983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:07.782281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5ded1b6c-f473-46fb-9c8f-a058bf8eee23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1597 microversion: 2.20 time: 0.292697 May 26 18:11:07.794354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 392/741] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:11:07 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1597 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:07.804548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:07.806650 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:07.814078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.814558 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.815338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:07.815772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:07.902738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-89f958a1-89cb-4ffb-91d1-1430448ee898 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102005 May 26 18:11:07.910344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 350/742] 10.222.0.76 () {60 vars in 1315 bytes} [Thu May 26 18:11:07 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:11:08.286461 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:08.287335 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:08.294404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=80 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:08.299016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.299605 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.300503 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.301132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.535841 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:08.557379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4b2d0b17-88d5-4623-89db-062ce423713e tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.275672 May 26 18:11:08.561887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 393/743] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:08 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:08.616425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:08.617478 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:08.626087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.626977 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.628316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.629010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.646018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 HTTP/1.1 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:08.648502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:08.652371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ee6393ca-e79a-4107-a73a-898478bef760'} May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:08.653199 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:08.654727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:08.656755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-db8329b7-f87e-45b3-b771-4c876d60f932 req-3d0da0ea-7894-4d75-92b1-588302986edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d037f7b-7d2e-440e-9e58-917176fdd5f4", "tag": "0050fac2-27f6-43c1-9c41-168fb25746b5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:08.658133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:08.659321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5619998f-f673-400f-ac38-a36c7d24a475 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 404 len: 111 microversion: 2.1 time: 0.048285 May 26 18:11:08.663753 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 394/744] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:08 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:08.669399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-282c5f5d-0a87-4201-9e7b-d65f384c9047 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '.version_select at 0x7f1fa03e5550>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:08.669698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-db8329b7-f87e-45b3-b771-4c876d60f932 req-3d0da0ea-7894-4d75-92b1-588302986edd service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.670318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-db8329b7-f87e-45b3-b771-4c876d60f932 req-3d0da0ea-7894-4d75-92b1-588302986edd service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.689237 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-db8329b7-f87e-45b3-b771-4c876d60f932 req-3d0da0ea-7894-4d75-92b1-588302986edd service nova] Creating event network-changed:0050fac2-27f6-43c1-9c41-168fb25746b5 for instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 on hv-cinder-83906 May 26 18:11:08.690081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-282c5f5d-0a87-4201-9e7b-d65f384c9047 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236212568" status: 202 len: 0 microversion: 2.1 time: 0.024907 May 26 18:11:08.694436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 395/745] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 26 18:11:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236212568 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:08.706942 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-db8329b7-f87e-45b3-b771-4c876d60f932 req-3d0da0ea-7894-4d75-92b1-588302986edd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128047 May 26 18:11:08.710774 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 351/746] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:11:08.788581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:08.790396 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:08.799189 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.799554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.801017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.801017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.836114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-23c35ab4-df62-465e-9f5c-c1277e71aa20 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/ips" status: 200 len: 145 microversion: 2.1 time: 0.054806 May 26 18:11:08.838379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 396/747] 10.222.0.76 () {58 vars in 1247 bytes} [Thu May 26 18:11:08 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:09.579600 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:09.581825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:09.592133 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:09.593027 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:09.594117 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:09.594851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.085019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:10.095309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6ac39c3-896f-409a-afc7-c4d600cad797 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.519933 May 26 18:11:10.109298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 352/748] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:09 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:10.440022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f580b53-f4d9-45c0-b72f-82261a469636"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:10.441293 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:10.453088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.454143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.456018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.456726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.578466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-1eadfdc5-8b16-42c6-bead-5d9dee9bfd87 req-9760c693-6a09-48f1-a516-f70e5e738aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:10.595180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1eadfdc5-8b16-42c6-bead-5d9dee9bfd87 req-9760c693-6a09-48f1-a516-f70e5e738aab service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.596250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1eadfdc5-8b16-42c6-bead-5d9dee9bfd87 req-9760c693-6a09-48f1-a516-f70e5e738aab service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.620111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-1eadfdc5-8b16-42c6-bead-5d9dee9bfd87 req-9760c693-6a09-48f1-a516-f70e5e738aab service nova] Creating event network-changed:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:11:10.629750 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-1eadfdc5-8b16-42c6-bead-5d9dee9bfd87 req-9760c693-6a09-48f1-a516-f70e5e738aab service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059290 May 26 18:11:10.631281 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 353/749] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:10.953702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:10.954332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:10.960767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.961324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.962072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.963190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.977985 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 HTTP/1.1 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:10.980288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:10.982145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ee6393ca-e79a-4107-a73a-898478bef760'} May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:10.982895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:10.984080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:10.985233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:10.985233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4cd33c3a-faee-4a76-96fd-5bc596dca05d tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 404 len: 111 microversion: 2.1 time: 0.032903 May 26 18:11:10.985382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 354/750] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:10 2022] DELETE /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:11:10.991200 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:10.991813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: ee6393ca-e79a-4107-a73a-898478bef760] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:10.999316 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.999767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.000861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.001044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.017123 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 HTTP/1.1 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:11.018717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:11.020364 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ee6393ca-e79a-4107-a73a-898478bef760'} May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:11.021220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. May 26 18:11:11.022963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:11.028161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance ee6393ca-e79a-4107-a73a-898478bef760 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:11.028161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ddbda76d-cb99-4dea-b502-99a562f3d7df tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760" status: 404 len: 111 microversion: 2.1 time: 0.037355 May 26 18:11:11.028161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 355/751] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:10 2022] GET /compute/v2.1/servers/ee6393ca-e79a-4107-a73a-898478bef760 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:11:11.117153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:11.118679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:11.131659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.133077 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.136598 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.140183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.262309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b38059ed-4c25-4c29-9eba-6645100f57a9 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825054 May 26 18:11:11.265316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 397/752] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:11:10 2022] POST /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:11.403523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:11.422644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bcb7da24-8429-4e54-9bc1-d464b8f5e425 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.312002 May 26 18:11:11.423721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 356/753] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:11 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:12.261017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:12.261602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:12.267866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.268324 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.269153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.269531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.283510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f HTTP/1.1 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:12.285154 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.286731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '55d1c756-d845-43f2-8ec2-0767b6a3be7f'} May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:12.287648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.289027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.291089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:12.291089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-616e78f5-6e25-4b74-b234-1e2f5ef2f9c5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 404 len: 111 microversion: 2.1 time: 0.030830 May 26 18:11:12.291089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 398/754] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:12 2022] DELETE /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:12.295787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:12.296403 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 55d1c756-d845-43f2-8ec2-0767b6a3be7f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:12.302909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.303362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.304127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.304563 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.318153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f HTTP/1.1 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:12.319684 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.322014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '55d1c756-d845-43f2-8ec2-0767b6a3be7f'} May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:12.322908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. May 26 18:11:12.324453 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.325794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 55d1c756-d845-43f2-8ec2-0767b6a3be7f could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:12.325794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-32153941-1272-4b41-9615-28eed30dafcc tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f" status: 404 len: 111 microversion: 2.1 time: 0.029228 May 26 18:11:12.325794 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 357/755] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:12 2022] GET /compute/v2.1/servers/55d1c756-d845-43f2-8ec2-0767b6a3be7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:12.330496 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:12.330998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:12.337658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.338251 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.339003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.339447 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.352918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e HTTP/1.1 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:12.354495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.356093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '80c10917-bf25-4d3c-990b-3c44c2b7847e'} May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:12.356984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.358502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:12.359959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:12.359959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1be077ad-9996-47c4-9a30-0b661b60e353 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 404 len: 111 microversion: 2.1 time: 0.029343 May 26 18:11:12.359959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 399/756] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:12 2022] DELETE /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:12.364156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:12.364782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 80c10917-bf25-4d3c-990b-3c44c2b7847e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:12.371077 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.371535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.372295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.372736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.387116 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e HTTP/1.1 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:12.388941 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.390801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '80c10917-bf25-4d3c-990b-3c44c2b7847e'} May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:12.392050 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. May 26 18:11:12.393629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:12.395265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 80c10917-bf25-4d3c-990b-3c44c2b7847e could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:12.395265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0d4fc9e2-7d8f-4a05-9faf-234de0356e35 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e" status: 404 len: 111 microversion: 2.1 time: 0.029669 May 26 18:11:12.395265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 358/757] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:12 2022] GET /compute/v2.1/servers/80c10917-bf25-4d3c-990b-3c44c2b7847e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:12.439384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:12.440140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:12.450047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.450047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.450047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:12.450047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:12.583746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:12.592418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ddcb3bb8-0e65-492b-a45c-39e05d9811ae tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.157046 May 26 18:11:12.592981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 400/758] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:12 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:13.529355 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:13.529850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:13.536404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.536858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.537617 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.538055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.552149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca HTTP/1.1 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:13.553680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.555278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '9288cf08-2b09-4c42-9831-8fbaa8f789ca'} May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:13.556795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.558217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:13.559569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:13.559569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5167ffe9-8338-4a8d-8dd9-6946cde118d5 tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 404 len: 111 microversion: 2.1 time: 0.029866 May 26 18:11:13.559569 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 359/759] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:13 2022] DELETE /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:13.564130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:13.564751 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] [instance: 9288cf08-2b09-4c42-9831-8fbaa8f789ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:13.571405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.571989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.572758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.573198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.586406 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] HTTP exception thrown: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Request method failure captured: May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca HTTP/1.1 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FO6yx1pFwOrKna6a97pR_a9N4sbIuHboUWcP_wfFnSu6FRiFwI2U0ZE5qG3OhayP6wm4dTCFp5WyRdiQ8RO8de3WEIMopQcO4tFvgWNH4NgwsvnOBDIbFD-kRH43Rxdib77D-8tt5jiqZwKUK3rWPkcLuBjERwgL5JORdQIptG_KQ May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:13.588655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_eac4a6151fbb44d1b0b61636a97f56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: eac4a6151fbb44d1b0b61636a97f56b6 May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-947375014 May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: dfbe23f3a0294148a88f4758d8470665 May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-947375014-project May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.590295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '9288cf08-2b09-4c42-9831-8fbaa8f789ca'} May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:13.591080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. May 26 18:11:13.592554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:13.593768 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] Returning 404 to user: Instance 9288cf08-2b09-4c42-9831-8fbaa8f789ca could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:13.593768 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d71fbdd-5c55-40dc-9392-902a371ea0be tempest-AttachVolumeNegativeTest-947375014 tempest-AttachVolumeNegativeTest-947375014-project] 10.222.0.76 "GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca" status: 404 len: 111 microversion: 2.1 time: 0.030104 May 26 18:11:13.593768 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 401/760] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:13 2022] GET /compute/v2.1/servers/9288cf08-2b09-4c42-9831-8fbaa8f789ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:13.610098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:13.611128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:13.617522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.618132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.619187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:13.619634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:13.753884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:13.762797 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de79da56-c2bc-48d1-97f8-e1fdf7664528 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.156240 May 26 18:11:13.763626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 360/761] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:13 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:14.781348 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:14.782625 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:14.790372 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:14.791210 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:14.792637 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:14.793233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:15.048800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:15.057722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eea21f81-beb6-44c6-bd3b-1bad96fed9ce tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.280463 May 26 18:11:15.066901 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 402/762] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:14 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:16.077768 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:16.079442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:16.091398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:16.092140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:16.092984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:16.093496 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:16.288944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:16.297404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f8ac4f1-6d26-41f8-80e9-fc405fad4dd7 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.223602 May 26 18:11:16.298009 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 361/763] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:16 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:17.316297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:17.316964 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:17.326844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:17.327286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:17.328066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:17.328511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:17.486433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:17.495976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da177174-b2a1-4eb9-a931-12c502c58f58 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.184512 May 26 18:11:17.496590 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 403/764] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:17 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:18.519363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:18.520261 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:18.530556 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.531020 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.531817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.532291 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.548163 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:18.685688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:18.697337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a97dc7a3-8fe6-430c-8f81-689da1d7367a tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.181745 May 26 18:11:18.698130 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 362/765] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:18 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:18.882111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:18.883212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:18.891110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.891598 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.892393 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.892860 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.924619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a190c2d2-f9f1-474c-a792-60ac0e0bc027 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046549 May 26 18:11:18.925294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 404/766] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:18 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:18.936376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:18.936953 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:18.943953 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.944408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.945183 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.945620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.975946 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a12bdea7-a38b-416d-ba14-bacd54217125 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636" status: 200 len: 194 microversion: 2.1 time: 0.044004 May 26 18:11:18.976471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 363/767] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 26 18:11:18 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:19.715172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:19.715789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:19.721919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:19.722417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:19.723192 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:19.723638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:19.860623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:19.868868 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2414642a-d667-4095-b757-4abd63b1e9e6 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.157978 May 26 18:11:19.869326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 405/768] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:19 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:20.325944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "027d4104-42d4-4abc-b2df-06d9e61bf9c9"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:20.326961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:20.333369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.333815 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:20.334601 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.335151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:20.625874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-02c88175-4fd7-45cc-8c77-bacc20b3b0cc tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "POST /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304086 May 26 18:11:20.631896 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 364/769] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:11:20 2022] POST /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:20.886862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:20.887505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:20.899065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.900225 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:20.901259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.901857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:21.061039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:21.068687 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce1fdc9e-6bee-4f6b-b775-192a8dd0ba95 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.186515 May 26 18:11:21.069287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 406/770] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:20 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:22.088152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:22.089212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:22.097628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.098017 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.099032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.099487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.267482 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:22.277141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-852f36f1-414e-4415-bca4-03ea638b47ff tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.193658 May 26 18:11:22.277710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 365/771] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:22 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:22.282820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-58d177ca-e4ca-4881-8d95-5f567319b441 req-c0c1f4f6-241e-4631-8fb0-8250c7129a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "name": "network-vif-plugged", "status": "completed", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:22.293200 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-58d177ca-e4ca-4881-8d95-5f567319b441 req-c0c1f4f6-241e-4631-8fb0-8250c7129a42 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.293656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-58d177ca-e4ca-4881-8d95-5f567319b441 req-c0c1f4f6-241e-4631-8fb0-8250c7129a42 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.306477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-58d177ca-e4ca-4881-8d95-5f567319b441 req-c0c1f4f6-241e-4631-8fb0-8250c7129a42 service nova] Creating event network-vif-plugged:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:11:22.311764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-58d177ca-e4ca-4881-8d95-5f567319b441 req-c0c1f4f6-241e-4631-8fb0-8250c7129a42 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033484 May 26 18:11:22.312395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 407/772] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:23.294521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:23.295148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:23.301981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.302483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.303277 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.303716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.441078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:23.449762 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-01d085b4-1cc4-4746-8169-d99b411728fe tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.159133 May 26 18:11:23.450392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 366/773] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:23 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:24.468883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:24.469498 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:24.476073 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.476554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.477516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.477954 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.620792 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:24.630940 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-74afe84e-a839-42dc-8506-8d222bb20ff9 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.166801 May 26 18:11:24.631544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 408/774] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:24 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:25.649724 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:25.650819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:25.658631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.659109 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.660023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.660463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.825890 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:25.833774 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-76488827-e278-4878-a6bb-d7b0105d9c8b tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1574 microversion: 2.1 time: 0.188613 May 26 18:11:25.834410 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 367/775] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:25 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:26.854359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:26.854994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:26.863257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.863716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.864507 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.865114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:27.027314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:27.036090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-268ffe3d-babd-4e2c-bd88-41217f97eeaa tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1561 microversion: 2.1 time: 0.187815 May 26 18:11:27.042262 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 409/776] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:26 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:29.232088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:29.233093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:29.240046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.240500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.241279 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.241720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.273450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-161a09bb-9bfa-4a2e-88a2-f241affd8326 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044807 May 26 18:11:29.273726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 368/777] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:29 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:29.419764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:29.420363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:29.427076 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.427712 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.428365 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.429048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.463626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5fae9965-f63f-4f81-b97d-4c7c35a523d6 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636" status: 200 len: 194 microversion: 2.1 time: 0.049989 May 26 18:11:29.464254 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 410/778] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 26 18:11:29 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:29.474064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:29.474599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:29.481559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.482436 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.483238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.483849 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.572350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lazy-loading 'services' on Instance uuid 80eb2910-b54f-4923-90f4-a5c99f742638 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:11:29.652611 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eac1a3ba-4b0c-46ed-b3e3-daf75c590092 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636" status: 202 len: 0 microversion: 2.1 time: 0.181860 May 26 18:11:29.653531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 369/779] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:11:29 2022] DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/5f580b53-f4d9-45c0-b72f-82261a469636 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:31.875748 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:31.876450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:31.882897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.883852 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:31.884969 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.885410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:31.916139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e2959c2-f08b-4aa1-829d-10c514df723f tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/027d4104-42d4-4abc-b2df-06d9e61bf9c9" status: 200 len: 194 microversion: 2.1 time: 0.044421 May 26 18:11:31.916753 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 411/780] 10.222.0.76 () {58 vars in 1412 bytes} [Thu May 26 18:11:31 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/027d4104-42d4-4abc-b2df-06d9e61bf9c9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:31.929559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:31.930307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:31.938391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.938810 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:31.939602 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.940223 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:32.036170 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lazy-loading 'services' on Instance uuid 80eb2910-b54f-4923-90f4-a5c99f742638 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:11:32.111619 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a23b3e03-add4-49c2-b178-b99d737f1c0d tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/027d4104-42d4-4abc-b2df-06d9e61bf9c9" status: 202 len: 0 microversion: 2.1 time: 0.187376 May 26 18:11:32.112213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 370/781] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:11:31 2022] DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments/027d4104-42d4-4abc-b2df-06d9e61bf9c9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:34.344095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:34.345057 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:34.351621 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.352597 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.353466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.353902 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.379499 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:34.383860 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-152c680f-5150-444a-8515-6407dcb7052e tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043782 May 26 18:11:34.384646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 412/782] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:34 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:11:34.495713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:34.496776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:34.503337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.503788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.504559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.504997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.534744 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5dc1f66e-a386-464c-a285-24ff340cd200 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043934 May 26 18:11:34.535299 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 371/783] 10.222.0.76 () {58 vars in 1301 bytes} [Thu May 26 18:11:34 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:11:34.595198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:34.595747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:34.604362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.604909 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.605900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.606404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.632810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:11:34.720886 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3965272-a5e9-4351-820c-e37c94c080d3 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 204 len: 0 microversion: 2.1 time: 0.129460 May 26 18:11:34.721943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 413/784] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:34 2022] DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:11:34.734306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:34.735027 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:34.741235 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.741687 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.742489 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.742933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.885431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:34.893031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c009dd49-3663-4779-ba4f-fa37ae780e1a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.163216 May 26 18:11:34.893604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 372/785] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:34 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:35.911291 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:35.911993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:35.918470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.918922 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:35.919689 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.920130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:36.048900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:36.057042 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-491659e0-ea80-465c-8763-8854f56b9d78 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.149845 May 26 18:11:36.057545 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 414/786] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:35 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:37.074546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:37.075226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:37.077800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=54 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:37.083900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.084401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.085240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.085693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.229499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:37.237883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8801037c-986c-44a2-9dcb-ed538a7ccf76 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.167815 May 26 18:11:37.238564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 373/787] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:37 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:38.255565 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:38.256502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:38.264095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.264560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.265350 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.265797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.398540 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:38.406400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-16df6425-49cd-4350-ad75-abbbaa5fb0ab tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.154887 May 26 18:11:38.406963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 415/788] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:38 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:39.423477 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:39.424039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:39.430589 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.431049 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:39.431924 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.432369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:39.560462 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:39.568058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0cf97cb8-07d0-49ff-b33e-b5b34684eeba tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.148503 May 26 18:11:39.568632 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 374/789] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:39 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:40.586458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:40.587280 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:40.590693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:40.596769 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:40.597268 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:40.598140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:40.598655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:40.733840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:40.741639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d00fc787-ae59-40d1-b4af-175f599f5612 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1672 microversion: 2.1 time: 0.159693 May 26 18:11:40.742228 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 416/790] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:40 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:41.609312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-1d69edb6-7406-4cc8-89e0-c311e941df2f req-5f6d9bb4-7ebd-4e9e-b152-8a1661bec46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb2910-b54f-4923-90f4-a5c99f742638", "name": "network-vif-deleted", "tag": "d9b71324-5001-44e0-b552-2414d6973840"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:41.618913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1d69edb6-7406-4cc8-89e0-c311e941df2f req-5f6d9bb4-7ebd-4e9e-b152-8a1661bec46c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.619658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1d69edb6-7406-4cc8-89e0-c311e941df2f req-5f6d9bb4-7ebd-4e9e-b152-8a1661bec46c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.631535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-1d69edb6-7406-4cc8-89e0-c311e941df2f req-5f6d9bb4-7ebd-4e9e-b152-8a1661bec46c service nova] Creating event network-vif-deleted:d9b71324-5001-44e0-b552-2414d6973840 for instance 80eb2910-b54f-4923-90f4-a5c99f742638 on hv-cinder-83906 May 26 18:11:41.637082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-1d69edb6-7406-4cc8-89e0-c311e941df2f req-5f6d9bb4-7ebd-4e9e-b152-8a1661bec46c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031367 May 26 18:11:41.637965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 375/791] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:41.762655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:41.763277 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:41.770011 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.770657 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.771359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.771899 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.818827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.819281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.821201 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lazy-loading 'fault' on Instance uuid 80eb2910-b54f-4923-90f4-a5c99f742638 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:11:41.866755 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b5113ea0f4484ba91a5f0e6184ca35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b976166b884524b9a3855712be72de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:41.874477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8de9763c-00fc-4fdd-9e54-ef842c71a5cf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 200 len: 1326 microversion: 2.1 time: 0.117490 May 26 18:11:41.875053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 417/792] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:41 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:42.893091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:42.893708 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:42.900521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:42.900971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:42.901739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:42.902179 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:42.916613 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 HTTP/1.1 May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:42.918288 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:42.919972 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '80eb2910-b54f-4923-90f4-a5c99f742638'} May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:42.920823 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:42.922352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:42.923659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:42.923659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bf551b72-c5bc-4da8-a8d0-9ca5a17249bb tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 404 len: 111 microversion: 2.1 time: 0.031390 May 26 18:11:42.923659 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 376/793] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:42 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:42.928559 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad0a1b9a-546a-4545-bf74-ceed0eb8656a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '.version_select at 0x7f1fa05d3280>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:42.947460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad0a1b9a-546a-4545-bf74-ceed0eb8656a tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148660638" status: 202 len: 0 microversion: 2.1 time: 0.022659 May 26 18:11:42.948017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 418/794] 10.222.0.76 () {58 vars in 1217 bytes} [Thu May 26 18:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148660638 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:48.243290 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:48.244096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:48.252921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.253403 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.254212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.254652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.269028 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 HTTP/1.1 May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:48.270605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.272132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '80eb2910-b54f-4923-90f4-a5c99f742638'} May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:48.273090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.275275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:48.277090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:48.277090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9d32ecd2-c181-400a-b492-811f131b54bf tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 404 len: 111 microversion: 2.1 time: 0.033126 May 26 18:11:48.277090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 377/795] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:48 2022] DELETE /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:48.286068 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:48.287011 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: 80eb2910-b54f-4923-90f4-a5c99f742638] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:48.295397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.295862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.296638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.297081 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.311039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 HTTP/1.1 May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:48.312723 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.314281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '80eb2910-b54f-4923-90f4-a5c99f742638'} May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:48.315194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. May 26 18:11:48.316578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:48.317684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance 80eb2910-b54f-4923-90f4-a5c99f742638 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:48.317684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34a29cfa-2009-4e33-96ec-3c2d9ef76824 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638" status: 404 len: 111 microversion: 2.1 time: 0.035958 May 26 18:11:48.317684 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 419/796] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:48 2022] GET /compute/v2.1/servers/80eb2910-b54f-4923-90f4-a5c99f742638 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:51.558850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:51.559383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:51.566049 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.566576 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.567368 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.567850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.572806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:51.584700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb HTTP/1.1 May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:11:51.586842 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.588616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'c8623e13-810b-433d-9e9d-e588bb5781eb'} May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:51.590169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.592809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:11:51.595370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:51.595370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8ba47326-fe89-4ca5-b783-d49f77078091 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 404 len: 111 microversion: 2.1 time: 0.034635 May 26 18:11:51.595370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 378/797] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:11:51 2022] DELETE /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:51.600749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:51.601500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] [instance: c8623e13-810b-433d-9e9d-e588bb5781eb] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:51.612175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.612638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.613424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.613877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.634403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] HTTP exception thrown: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Request method failure captured: May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb HTTP/1.1 May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8FH64apuU3rcw9mW7sv_Ncysc_qWTiV114HjFKeg6jKpqrf2_MeuYAJbi_a463rfvwuA37Nj0D9zW0_A5Oavr5jHG6pFda-CE8Vz0ueIaURTPgD1mjimvDdJpoy1-Y3vmf4oTLOIZ6P3VumVhFGPE82E4a7tpeDJnhHGU5Rr-_YLQk May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: c0b976166b884524b9a3855712be72de May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:11:51.635949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c0b976166b884524b9a3855712be72de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c0b976166b884524b9a3855712be72de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c0b976166b884524b9a3855712be72de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c0b976166b884524b9a3855712be72de May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141398587 May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: f6b5113ea0f4484ba91a5f0e6184ca35 May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-141398587-project May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.637594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'c8623e13-810b-433d-9e9d-e588bb5781eb'} May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:51.638726 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. May 26 18:11:51.640143 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:11:51.641441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] Returning 404 to user: Instance c8623e13-810b-433d-9e9d-e588bb5781eb could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:51.641441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-53382441-f912-4c33-b1b8-bc92cc7f7280 tempest-AttachVolumeTestJSON-141398587 tempest-AttachVolumeTestJSON-141398587-project] 10.222.0.76 "GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb" status: 404 len: 111 microversion: 2.1 time: 0.041619 May 26 18:11:51.641441 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 420/798] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:11:51 2022] GET /compute/v2.1/servers/c8623e13-810b-433d-9e9d-e588bb5781eb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:11:57.477536 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5fe1b00f-4436-4b23-9430-06b354e03021 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa0176940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:57.526328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5fe1b00f-4436-4b23-9430-06b354e03021 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/73d09200-1baa-4c10-9c64-12fbabf6641c" status: 200 len: 351 microversion: 2.1 time: 0.053023 May 26 18:11:57.526893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 379/799] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:11:57 2022] GET /compute/v2.1/os-volumes/73d09200-1baa-4c10-9c64-12fbabf6641c => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:58.861578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1fe9e865-1b14-47c1-96d9-60758650c81b tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa03e51f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:58.912135 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1fe9e865-1b14-47c1-96d9-60758650c81b tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/63a56dc4-67e3-43a6-a703-644df48be106" status: 200 len: 351 microversion: 2.1 time: 0.054345 May 26 18:11:58.912778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 421/800] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:11:58 2022] GET /compute/v2.1/os-volumes/63a56dc4-67e3-43a6-a703-644df48be106 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:00.238649 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-607fcec8-2ac5-4c0d-9357-fbb9fa0c9cd6 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa0143e50>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.287466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-607fcec8-2ac5-4c0d-9357-fbb9fa0c9cd6 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/af40c8ff-80c9-419a-a809-e0712f0f5706" status: 200 len: 351 microversion: 2.1 time: 0.053017 May 26 18:12:00.288057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 380/801] 10.222.0.76 () {58 vars in 1244 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes/af40c8ff-80c9-419a-a809-e0712f0f5706 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:00.301261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d896afcf-6819-4f47-afc0-d7c47cfc74d6 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa057caf0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.407096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d896afcf-6819-4f47-afc0-d7c47cfc74d6 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.110924 May 26 18:12:00.407662 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 422/802] 10.222.0.76 () {58 vars in 1133 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:00.419725 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-76ce2b3d-d616-478f-9725-b36c86ff760d tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa01ca940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.498909 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-76ce2b3d-d616-478f-9725-b36c86ff760d tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082913 May 26 18:12:00.499476 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 381/803] 10.222.0.76 () {58 vars in 1148 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:00.511628 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-643c5d00-0798-4c72-9906-0f6d1ac1802a tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa03e51f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.593477 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-643c5d00-0798-4c72-9906-0f6d1ac1802a tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086224 May 26 18:12:00.594046 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 423/804] 10.222.0.76 () {58 vars in 1133 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:00.605582 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cdbd52b4-ec58-4ca5-ba63-1d309c8c1e39 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa013b940>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.687479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cdbd52b4-ec58-4ca5-ba63-1d309c8c1e39 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085602 May 26 18:12:00.688142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 382/805] 10.222.0.76 () {58 vars in 1166 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:00.700453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2545f9a-99a9-4df7-b4f6-179b9ead6ef2 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa03cfe50>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.781975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2545f9a-99a9-4df7-b4f6-179b9ead6ef2 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085361 May 26 18:12:00.782596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 424/806] 10.222.0.76 () {58 vars in 1169 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:00.795735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ea080fd-39ee-4972-ab83-764216413336 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa0143ca0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.877632 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8ea080fd-39ee-4972-ab83-764216413336 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086008 May 26 18:12:00.878358 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 383/807] 10.222.0.76 () {58 vars in 1154 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:00.890072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc00dbce-ebb4-494a-b804-b8bc2b559981 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa01fc550>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:00.985872 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc00dbce-ebb4-494a-b804-b8bc2b559981 tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099503 May 26 18:12:00.986672 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 425/808] 10.222.0.76 () {58 vars in 1187 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:01.000270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d498e3fd-92a4-40ba-bcd0-44c7350c001c tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] Calling method '.version_select at 0x7f1fa0143a60>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:01.095637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d498e3fd-92a4-40ba-bcd0-44c7350c001c tempest-VolumesTestJSON-1556776760 tempest-VolumesTestJSON-1556776760-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099819 May 26 18:12:01.096473 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 384/809] 10.222.0.76 () {58 vars in 1154 bytes} [Thu May 26 18:12:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:05.964007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:05.964759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:05.968846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:05.969325 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:05.976839 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:05.977253 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:05.978077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:05.978472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:06.006634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-79055ae1-3ef5-4db3-8352-dda1174db365 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/ips" status: 200 len: 150 microversion: 2.20 time: 0.043750 May 26 18:12:06.007359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 426/810] 10.222.0.76 () {60 vars in 1288 bytes} [Thu May 26 18:12:05 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:12:09.017692 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=11 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:09.018630 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:09.023491 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:09.024151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:09.031668 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:09.032208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:09.032900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:09.033369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:09.058421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lazy-loading 'flavor' on Instance uuid 6fabdc26-1a43-41bd-849f-797ba0e5b73b {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:12:09.379900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dc87fe15-507d-47ae-a0ec-c55d0d1485d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/action" status: 202 len: 0 microversion: 2.20 time: 0.363115 May 26 18:12:09.380765 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 385/811] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 26 18:12:09 2022] POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:12:09.389980 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:09.391032 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:09.398853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:09.400209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:09.400429 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:09.401089 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:09.540635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:09.548585 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:09.550013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:09.551207 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-304a47bb-6f94-42c3-9df6-7ec760eb5c4a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.165219 May 26 18:12:09.551759 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 427/812] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:09 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:10.570579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:10.571448 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:10.577878 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:10.578388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:10.579164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:10.579605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:10.715164 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:10.723244 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:10.724772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:10.725943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d57c7297-bb47-4c37-9b03-dd1ebdf3d12f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.160491 May 26 18:12:10.727083 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 386/813] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:10 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:11.745830 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:11.746482 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:11.753232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:11.753907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:11.754996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:11.755440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:11.896820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:11.905835 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:11.907421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:11.908583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fee2c9b0-c5d9-47d6-8cfe-cd600be320da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.167651 May 26 18:12:11.909356 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 428/814] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:11 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:12.927808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:12.928423 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:12.935248 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:12.935700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:12.936469 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:12.936907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:13.084325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:13.095838 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:13.097555 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:13.098954 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f22a83d-a178-48b2-ab9f-02e13c19efa3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.174850 May 26 18:12:13.100930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 387/815] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:12 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:14.120096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:14.120741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:14.127318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:14.127778 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:14.128569 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:14.129013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:14.274487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:14.283018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:14.284533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:14.285715 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-467966bc-90b7-4117-aa27-d68e501b19d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.170465 May 26 18:12:14.286306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 429/816] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:14 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:15.305481 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:15.306113 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:15.312733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:15.313195 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:15.313967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:15.314460 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:15.459038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:15.467153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:15.468802 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:15.470039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f97e94cc-311d-41f5-8e85-029f9c9e7d68 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.169206 May 26 18:12:15.470701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 388/817] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:15 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:16.490618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:16.491231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:16.498507 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:16.499079 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:16.500018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:16.500527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:16.703075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:16.714563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:16.717281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:16.718502 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-40f8ba4a-04b5-42d2-b96b-a890a8e11d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.232370 May 26 18:12:16.719088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 430/818] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:16 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:17.736897 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:17.737513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:17.744735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:17.745195 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:17.745965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:17.746430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:18.075598 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:18.089127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:18.090908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:18.092167 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-206a18bb-cadb-4d7e-bda1-ffed4210aeaf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.359264 May 26 18:12:18.092790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 389/819] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:17 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:19.111090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:19.111707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:19.119116 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:19.120875 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:19.121493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:19.121939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:19.317912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:19.327511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:19.329226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:19.330613 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c2c7ae04-c1bc-4353-b996-ac246dd97585 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.223350 May 26 18:12:19.331178 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 431/820] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:19 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:20.076853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1035705100", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "networks": [{"uuid": "edac086d-b832-4f25-9ca5-779f3fe669ed"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:20.130832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] validate_networks() for [('edac086d-b832-4f25-9ca5-779f3fe669ed', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:12:20.349140 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:20.349756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:20.357349 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:20.358350 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:20.359912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:20.360633 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:20.519363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:20.529088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:20.530501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:12:20.530658 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:20.530942 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:12:20.531421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:12:20.531800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fb58198e-1cb5-4932-b642-6b286be9dc51 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1742 microversion: 2.20 time: 0.186835 May 26 18:12:20.532007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:12:20.532598 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 432/821] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:20 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:20.532774 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:12:20.542904 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:20.543365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:20.544168 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:20.544642 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:20.563047 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Getting quotas for project 6217142c97d54164a23b27dafacd083f. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:12:20.567405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Getting quotas for user e98003818ed84c9b8e2301467edebdd6 and project 6217142c97d54164a23b27dafacd083f. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:12:20.580014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:12:20.582521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:12:20.630103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7a7e3c7f-2b64-4fd4-8000-a8c7a5881805 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556974 May 26 18:12:20.631099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 390/822] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:12:20.641989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2c324750-90b6-4c65-82c6-828cf5cac1eb tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:20.643922 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2c324750-90b6-4c65-82c6-828cf5cac1eb tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:20.711863 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2c324750-90b6-4c65-82c6-828cf5cac1eb tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:20.718954 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2c324750-90b6-4c65-82c6-828cf5cac1eb tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1214 microversion: 2.1 time: 0.081743 May 26 18:12:20.719541 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 433/823] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:20 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:21.551159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:21.551776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:21.558779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:21.559238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:21.560010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:21.560449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:21.727272 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:21.737072 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:21.737857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:21.752006 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:21.753782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:21.754963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:21.755478 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:21.756321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:21.759077 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c4401a62-dc5b-4b58-b443-873230e5dc2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1742 microversion: 2.20 time: 0.211740 May 26 18:12:21.759678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:21.762779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 391/824] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:21 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1742 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:21.835088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:21.844876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d9e8760f-904f-4b80-bd5f-a8b6ce7f0d35 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1274 microversion: 2.1 time: 0.112293 May 26 18:12:21.845821 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 434/825] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:21 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:22.780911 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:22.782174 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:22.791080 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:22.791616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:22.793431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:22.793431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:22.863646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:22.865025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:22.873163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:22.874220 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:22.875097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:22.875744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:23.028655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:23.038786 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-173b6e02-7187-48f7-8677-d5a2b2308ce4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.178938 May 26 18:12:23.039832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 435/826] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:22 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:23.169988 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-80042eda-58f3-44cf-9af8-2963c23aaf85 req-9c08b526-2c86-4f16-be71-a899ae0090e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "name": "network-vif-plugged", "status": "completed", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:23.181201 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-80042eda-58f3-44cf-9af8-2963c23aaf85 req-9c08b526-2c86-4f16-be71-a899ae0090e9 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:23.182136 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:23.182536 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-80042eda-58f3-44cf-9af8-2963c23aaf85 req-9c08b526-2c86-4f16-be71-a899ae0090e9 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:23.193391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:23.196441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:23.197998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-704ddcec-6081-4e34-bde9-d8937986c7b3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.421432 May 26 18:12:23.211389 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 392/827] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:22 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:23.215869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-80042eda-58f3-44cf-9af8-2963c23aaf85 req-9c08b526-2c86-4f16-be71-a899ae0090e9 service nova] Creating event network-vif-plugged:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:12:23.229995 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-80042eda-58f3-44cf-9af8-2963c23aaf85 req-9c08b526-2c86-4f16-be71-a899ae0090e9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063651 May 26 18:12:23.234589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 436/828] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:23.413438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-99aa1cff-5954-4494-bc83-9ad1dd360a41 req-88b1bd5a-f44b-43dd-9972-e85742b344ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9", "tag": "5caebdeb-9b28-4cbc-abbd-ec7e5495fe37"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:23.425751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-99aa1cff-5954-4494-bc83-9ad1dd360a41 req-88b1bd5a-f44b-43dd-9972-e85742b344ca service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:23.426239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-99aa1cff-5954-4494-bc83-9ad1dd360a41 req-88b1bd5a-f44b-43dd-9972-e85742b344ca service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:23.453800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-99aa1cff-5954-4494-bc83-9ad1dd360a41 req-88b1bd5a-f44b-43dd-9972-e85742b344ca service nova] Creating event network-changed:5caebdeb-9b28-4cbc-abbd-ec7e5495fe37 for instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 on hv-cinder-83906 May 26 18:12:23.459363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-99aa1cff-5954-4494-bc83-9ad1dd360a41 req-88b1bd5a-f44b-43dd-9972-e85742b344ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050821 May 26 18:12:23.460249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 393/829] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:24.057288 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:24.060036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:24.068698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:24.069262 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:24.070644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:24.071278 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:24.218911 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:24.220565 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:24.227317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:24.228059 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:24.231752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:24.232421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:24.246492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:24.256533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc08f3e5-884a-4d89-92c1-b491bb319841 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.203339 May 26 18:12:24.258798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 437/830] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:24 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:24.388290 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:24.397856 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:24.399414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:24.400781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a808d1a-dda9-49b5-9afd-92e10002efd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.187043 May 26 18:12:24.401504 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 394/831] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:24 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:25.277426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:25.279256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:25.292077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.293166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.296233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.305346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.420538 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:25.421092 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:25.439579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.440037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.451381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.451851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.662583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:25.673936 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e50dc3ec-8bdf-41d7-a31b-f66fbb25bf24 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.402555 May 26 18:12:25.675169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 438/832] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:25 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:25.736844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:25.747515 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:25.750131 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:25.752159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41a9a00f-5f2f-425d-a2ca-6f980b25726d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.335607 May 26 18:12:25.754579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 395/833] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:25 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:26.691747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:26.692537 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:26.704760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:26.705593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:26.707112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:26.708267 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:26.777125 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:26.778535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:26.791007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:26.791758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:26.793510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:26.794621 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:26.909421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:26.923103 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b8948b83-8b40-47e1-ab66-fb4671cadf56 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.235395 May 26 18:12:26.935386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 439/834] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:26 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:26.991149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:27.002833 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:27.015544 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:27.016792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-44a2fb70-1daf-4497-938a-7211eca05672 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.247267 May 26 18:12:27.017346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 396/835] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:26 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:27.246693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-2da05b9d-df63-4921-9437-4559742b64de req-551de77d-fa0a-4f00-936b-afbb0c587ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9", "name": "network-vif-plugged", "status": "completed", "tag": "5caebdeb-9b28-4cbc-abbd-ec7e5495fe37"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:27.259173 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2da05b9d-df63-4921-9437-4559742b64de req-551de77d-fa0a-4f00-936b-afbb0c587ecb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.260242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2da05b9d-df63-4921-9437-4559742b64de req-551de77d-fa0a-4f00-936b-afbb0c587ecb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.276970 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-2da05b9d-df63-4921-9437-4559742b64de req-551de77d-fa0a-4f00-936b-afbb0c587ecb service nova] Creating event network-vif-plugged:5caebdeb-9b28-4cbc-abbd-ec7e5495fe37 for instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 on hv-cinder-83906 May 26 18:12:27.284289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-2da05b9d-df63-4921-9437-4559742b64de req-551de77d-fa0a-4f00-936b-afbb0c587ecb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042825 May 26 18:12:27.285267 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 440/836] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:12:27.946765 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:27.948836 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:27.981667 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.982995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.984143 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.984994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.045358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:28.046811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:28.057133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.057932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.058965 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.059485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.233617 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:28.245082 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-10d0a47e-2196-4f35-be2f-cc92064c27dc tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.305538 May 26 18:12:28.246337 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 397/837] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:27 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:28.300607 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:28.316207 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:28.318472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:28.320981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-61a0ce69-72b6-47fc-9e37-c94208759d36 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.286808 May 26 18:12:28.321765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 441/838] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:28 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:29.264620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:29.265142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:29.281606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.282372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.283495 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.284090 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.341231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:29.341861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:29.349830 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.350425 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.351908 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.352512 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.554996 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:29.565738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c290464a-663c-4ab0-9e42-8c4d15788afe tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1314 microversion: 2.1 time: 0.306135 May 26 18:12:29.566955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:29.567135 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 398/839] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:29 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:29.576878 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:29.578761 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:29.580369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-762fa10b-faee-4d31-9658-25513ab2d260 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.242945 May 26 18:12:29.581286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 442/840] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:29 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:30.584463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:30.585531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:30.591868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:30.593147 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:30.601180 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:30.602515 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:30.609240 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.610045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.612599 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.613257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.614006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.615305 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.617696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.621917 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.722780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:30.826820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:30.841479 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c193acb0-a747-4c9b-af03-cb751b0c7315 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1498 microversion: 2.1 time: 0.255972 May 26 18:12:30.842431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 399/841] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:30 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:30.886434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:30.894644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:30.896214 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:30.897443 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0fe1267d-1c4e-49fd-8e1b-8e2df331f7e4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.302381 May 26 18:12:30.898016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 443/842] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:30 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:31.414412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:31.415259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:31.422493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.423205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.424178 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.425350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.459546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:12:31.464459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:31.560997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f55539a-0914-40c1-8add-264b84d05113 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 204 len: 0 microversion: 2.1 time: 0.155195 May 26 18:12:31.561785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 400/843] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:12:31 2022] DELETE /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:31.572175 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:31.572811 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:31.583318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.584047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.585038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.585678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.756438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:31.765562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-836b2980-19cc-4ccc-831f-a064a0e32797 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1504 microversion: 2.1 time: 0.198940 May 26 18:12:31.775048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 444/844] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:31 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:31.920761 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:31.922512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:31.932848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.933690 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.935094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.935562 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.224755 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:32.234510 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:32.236406 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:32.237611 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-640b859d-7bef-4e1f-b3f8-fc57831e02a0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.321555 May 26 18:12:32.251683 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 401/845] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:31 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:32.790296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:32.792617 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:32.802390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.805114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.807796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.809235 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.816398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:32.980344 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:32.989809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4156e87-2e84-4e2e-8420-74794558b03a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1504 microversion: 2.1 time: 0.204257 May 26 18:12:32.991388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 445/846] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:32 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:33.261475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:33.262634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:33.274329 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:33.277137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:33.279063 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:33.282325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:33.555110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:33.564603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:33.566657 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:33.568107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-03695e61-ea4c-4ede-9d78-2fd4aac6256d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1737 microversion: 2.20 time: 0.313161 May 26 18:12:33.569310 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 402/847] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:33 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1737 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:33.899648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-9942a3fb-b9c0-49e1-816d-8ced04d940ef req-4b927ef9-030f-470a-80a2-2139333068d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9", "name": "network-vif-deleted", "tag": "5caebdeb-9b28-4cbc-abbd-ec7e5495fe37"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:33.910731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9942a3fb-b9c0-49e1-816d-8ced04d940ef req-4b927ef9-030f-470a-80a2-2139333068d6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:33.911185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9942a3fb-b9c0-49e1-816d-8ced04d940ef req-4b927ef9-030f-470a-80a2-2139333068d6 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:33.924689 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-9942a3fb-b9c0-49e1-816d-8ced04d940ef req-4b927ef9-030f-470a-80a2-2139333068d6 service nova] Creating event network-vif-deleted:5caebdeb-9b28-4cbc-abbd-ec7e5495fe37 for instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 on hv-cinder-83906 May 26 18:12:33.931040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-9942a3fb-b9c0-49e1-816d-8ced04d940ef req-4b927ef9-030f-470a-80a2-2139333068d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036639 May 26 18:12:33.931624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 446/848] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:34.010581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:34.011213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:34.017980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:34.018540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:34.019418 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:34.020078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:34.098371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:34.107466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4383dfdb-94e2-4e2e-845f-5a7b5086776c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 200 len: 1299 microversion: 2.1 time: 0.100795 May 26 18:12:34.108230 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 403/849] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:34 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:34.587951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:34.588667 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:34.595573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:34.596028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:34.596847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:34.597286 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:34.768032 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:34.776807 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:34.779139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:34.780964 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7f235a7f-ac2b-4dc7-a8e3-b60dae4b87a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1719 microversion: 2.20 time: 0.197080 May 26 18:12:34.781976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 447/850] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:34 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:35.124749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:35.125379 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:35.140296 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.140874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.141748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.142652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.159425 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] HTTP exception thrown: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Request method failure captured: May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 HTTP/1.1 May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8MCNZtx8vqAXWDLCnUoMjWA0FSt74KxB6M-IAfaE0hRNbyZ-dmQha6330Fy0gKDnrMaQUm-f4QXZiM4cILMqW_P4pNSRYp7svonWQImvE3Z8LGjuKi8KXYBotW-vEYPCr51ayU18ykiCtZzPd9PB64oYOds6vkb5VrqyQpG5Ow_hpA May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 6217142c97d54164a23b27dafacd083f May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesActionsTest-1154299485 May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:12:35.161372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6217142c97d54164a23b27dafacd083f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6217142c97d54164a23b27dafacd083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6217142c97d54164a23b27dafacd083f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6217142c97d54164a23b27dafacd083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesActionsTest-1154299485 May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 6217142c97d54164a23b27dafacd083f May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesActionsTest-1154299485 May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesActionsTest-1154299485-project May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: e98003818ed84c9b8e2301467edebdd6 May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesActionsTest-1154299485-project May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. May 26 18:12:35.164161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9'} May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:12:35.165045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. May 26 18:12:35.166381 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:12:35.168760 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Returning 404 to user: Instance 0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:12:35.169792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-83c031b2-825b-4ff9-8cad-92e656965663 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9" status: 404 len: 111 microversion: 2.1 time: 0.049002 May 26 18:12:35.170720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 404/851] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:35 2022] GET /compute/v2.1/servers/0ffcfd3a-2331-4b47-82fb-639ce3fa6fe9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:12:35.302401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1731840522", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "networks": [{"uuid": "edac086d-b832-4f25-9ca5-779f3fe669ed"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:35.381174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] validate_networks() for [('edac086d-b832-4f25-9ca5-779f3fe669ed', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:12:35.801194 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:35.802100 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:35.809001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.809488 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.810279 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.810772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.910978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:12:35.911403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:12:35.911876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:12:35.912289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:12:35.912802 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:12:35.922354 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.922820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.923765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:35.924124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:35.942139 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Getting quotas for project 6217142c97d54164a23b27dafacd083f. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:12:35.947781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Getting quotas for user e98003818ed84c9b8e2301467edebdd6 and project 6217142c97d54164a23b27dafacd083f. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:12:35.954618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:35.960543 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:12:35.962807 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:12:35.963943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:35.965536 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:35.966868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-18fa8409-873b-41e3-979c-3ac30a970dec tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1719 microversion: 2.20 time: 0.169790 May 26 18:12:35.967493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 405/852] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:35 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:35.982436 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:36.010091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45b6a68c-6b3b-4aa7-9934-7a40f763c920 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711532 May 26 18:12:36.010797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 448/853] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:12:36.021675 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9463f151-5c6c-4472-ac2f-977e0edb0522 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:36.022923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9463f151-5c6c-4472-ac2f-977e0edb0522 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:36.078016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9463f151-5c6c-4472-ac2f-977e0edb0522 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:36.085682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9463f151-5c6c-4472-ac2f-977e0edb0522 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1214 microversion: 2.1 time: 0.068527 May 26 18:12:36.086282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 406/854] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:36 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:36.992008 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:36.992853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:37.008124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:37.008838 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:37.009709 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:37.010209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:37.105637 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:37.112643 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:37.130850 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:37.131645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:37.132682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:37.133269 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:37.236444 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:37.244627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:37.247151 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0ad2c59f-47e6-4a79-bbed-e9c6b437722c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1210 microversion: 2.1 time: 0.147516 May 26 18:12:37.247737 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 407/855] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:37 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:37.256798 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:37.258634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:37.261855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cd6ae31e-0dc2-45fe-99d5-248077d73390 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1719 microversion: 2.20 time: 0.278907 May 26 18:12:37.262900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 449/856] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:36 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:37.324811 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9ccd7e7a-d9ef-4d9d-9264-de015c48b271 req-e2c9ae7e-a857-49dd-990c-f1f8f5678609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "name": "network-vif-unplugged", "status": "completed", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:37.343147 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ccd7e7a-d9ef-4d9d-9264-de015c48b271 req-e2c9ae7e-a857-49dd-990c-f1f8f5678609 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:37.344328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9ccd7e7a-d9ef-4d9d-9264-de015c48b271 req-e2c9ae7e-a857-49dd-990c-f1f8f5678609 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:37.368028 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9ccd7e7a-d9ef-4d9d-9264-de015c48b271 req-e2c9ae7e-a857-49dd-990c-f1f8f5678609 service nova] Creating event network-vif-unplugged:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:12:37.373886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9ccd7e7a-d9ef-4d9d-9264-de015c48b271 req-e2c9ae7e-a857-49dd-990c-f1f8f5678609 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057878 May 26 18:12:37.374714 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 408/857] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:38.267343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:38.268263 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:38.277022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.277022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:38.277022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.277405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:38.284815 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:38.288491 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:38.300200 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.301007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:38.301818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.302290 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:38.347510 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:38.355462 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a354c865-0270-4ba2-bffc-221a9990a056 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1272 microversion: 2.1 time: 0.094297 May 26 18:12:38.356059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 450/858] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:38 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:38.531927 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:38.542115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:38.543802 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:38.545093 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-037fea49-3c65-41f8-bfe9-d7decdd42b5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1662 microversion: 2.20 time: 0.265728 May 26 18:12:38.545732 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 409/859] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:38 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1662 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:38.563859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f568412-fed4-4a58-b0f6-f3c6c416ce1b"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:38.565396 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:38.572600 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.573326 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:38.574118 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:38.574762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.025343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-035e16ce-fa96-45eb-934c-e54f88684209 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.465621 May 26 18:12:39.026231 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 451/860] 10.222.0.76 () {62 vars in 1363 bytes} [Thu May 26 18:12:38 2022] POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments => generated 188 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:12:39.203533 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:39.204213 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:39.206443 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:39.213767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.214285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.215076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.215865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.326115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-33069532-3070-4600-add6-e0f9d2239a8e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/action" status: 202 len: 0 microversion: 2.20 time: 0.126502 May 26 18:12:39.327250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 410/861] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 26 18:12:39 2022] POST /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:39.338563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:39.339368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:39.348396 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.349076 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.350556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.351296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.373552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:39.374536 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:39.390107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.391120 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.392992 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.395492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.606674 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:39.618645 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:39.620378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:39.621698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88731a58-4e0d-411c-9cde-a11e4494432f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1748 microversion: 2.20 time: 0.289319 May 26 18:12:39.622716 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 452/862] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:39 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1748 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:39.753103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:39.765056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-21047e0b-eb43-4af2-b47b-5c9c7073b383 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.396276 May 26 18:12:39.765969 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 411/863] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:39 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:39.937837 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d8798f50-574b-4392-a55a-930816481b4d req-d3d2753c-c1f1-479e-ae55-0e43e1359ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65c23bc-71b7-44d4-a970-a8194641fa7c", "tag": "0ef2d923-5be7-4253-9dc6-70dcd9c2269d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:39.953496 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d8798f50-574b-4392-a55a-930816481b4d req-d3d2753c-c1f1-479e-ae55-0e43e1359ae7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:39.953674 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d8798f50-574b-4392-a55a-930816481b4d req-d3d2753c-c1f1-479e-ae55-0e43e1359ae7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:39.968458 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d8798f50-574b-4392-a55a-930816481b4d req-d3d2753c-c1f1-479e-ae55-0e43e1359ae7 service nova] Creating event network-changed:0ef2d923-5be7-4253-9dc6-70dcd9c2269d for instance d65c23bc-71b7-44d4-a970-a8194641fa7c on hv-cinder-83906 May 26 18:12:39.973593 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d8798f50-574b-4392-a55a-930816481b4d req-d3d2753c-c1f1-479e-ae55-0e43e1359ae7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040174 May 26 18:12:39.974211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 453/864] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:40.640766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:40.641551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:40.649517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:40.649970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:40.650833 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:40.651634 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:40.784292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:40.785127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:40.792709 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:40.793171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:40.794343 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:40.794791 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:40.813427 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:40.823780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:40.825412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:40.826661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ee9ea081-3c45-4e48-9049-48a958bfffc9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1748 microversion: 2.20 time: 0.190527 May 26 18:12:40.827277 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 412/865] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:40 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1748 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:40.948789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:40.956591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fad0c018-a00a-46bd-a86f-d1738535fa65 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.177467 May 26 18:12:40.957172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 454/866] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:40 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:41.847187 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:41.848388 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:41.856139 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:41.856959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:41.857814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:41.858280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:41.974307 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:41.975651 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:41.982934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:41.983685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:41.984472 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:41.984912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:42.034379 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:42.046944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:42.049847 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:42.051114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4476e0c3-3d58-4c78-95a4-2bb191f5773c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1750 microversion: 2.20 time: 0.207904 May 26 18:12:42.052001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 413/867] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:41 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:42.135150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:42.143932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bae9a4e6-b2db-4c64-a390-f9f2aa21fd7b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.173586 May 26 18:12:42.144623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 455/868] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:41 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:43.072286 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:43.072913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:43.079519 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:43.079981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:43.080753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:43.081194 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:43.161762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:43.164068 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:43.185815 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:43.189968 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:43.191004 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:43.191680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:43.322103 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:43.333004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:43.335915 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:43.338611 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-df050c72-dcc4-4614-925f-f1f3cf0dea78 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.271925 May 26 18:12:43.339688 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 414/869] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:43 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:43.346169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-fd4ac6c9-5329-4d0b-80d4-e76b3845a2dd req-6b328c8b-5773-41ff-92a7-17c498fee25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65c23bc-71b7-44d4-a970-a8194641fa7c", "name": "network-vif-plugged", "status": "completed", "tag": "0ef2d923-5be7-4253-9dc6-70dcd9c2269d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:43.355968 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fd4ac6c9-5329-4d0b-80d4-e76b3845a2dd req-6b328c8b-5773-41ff-92a7-17c498fee25d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:43.357733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fd4ac6c9-5329-4d0b-80d4-e76b3845a2dd req-6b328c8b-5773-41ff-92a7-17c498fee25d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:43.371370 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-fd4ac6c9-5329-4d0b-80d4-e76b3845a2dd req-6b328c8b-5773-41ff-92a7-17c498fee25d service nova] Creating event network-vif-plugged:0ef2d923-5be7-4253-9dc6-70dcd9c2269d for instance d65c23bc-71b7-44d4-a970-a8194641fa7c on hv-cinder-83906 May 26 18:12:43.376906 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-fd4ac6c9-5329-4d0b-80d4-e76b3845a2dd req-6b328c8b-5773-41ff-92a7-17c498fee25d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035154 May 26 18:12:43.377693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 415/870] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:43.396084 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:43.404916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d5454465-fe8e-4775-b243-6fb8c194e615 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.247536 May 26 18:12:43.405703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 456/871] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:43 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:44.360930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:44.362877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:44.371285 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:44.371741 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:44.372523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:44.373119 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:44.422497 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:44.423047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:44.431018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:44.431729 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:44.432776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:44.433294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:44.511118 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:44.519930 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:44.520991 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:44.522282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e911c236-4b90-45be-857e-99667099b5a8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.168419 May 26 18:12:44.523420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 416/872] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:44 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:44.584893 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:44.593907 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-85fd03c6-2cfa-4d7e-900f-f7d40d6572c7 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.175331 May 26 18:12:44.594876 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 457/873] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:44 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:45.541585 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:45.542309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:45.549064 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:45.549522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:45.550363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:45.550951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:45.612187 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:45.613564 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:45.638466 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:45.639209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:45.640159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:45.640756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:45.713203 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:45.716788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:45.723776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:45.725350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:45.726808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2f23a1fe-b073-4330-b328-b331dab76a02 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.189137 May 26 18:12:45.738844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 417/874] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:45 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:45.825144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:45.833038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db43019a-79cb-4f7e-88a2-36a3a117246b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.224680 May 26 18:12:45.833619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 458/875] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:45 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:46.746205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:46.746948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:46.749209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:46.756192 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:46.756759 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:46.757625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:46.758138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:46.851287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:46.852080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:46.854782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:46.855530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:46.862563 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:46.863591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:46.864636 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:46.865523 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:46.923522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:46.934070 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:46.935604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:46.936786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8fdc2ebc-7285-4e89-bec1-fb2aa92d3925 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.194506 May 26 18:12:46.937438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 418/876] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:46 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:47.030430 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:47.038739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7be04eb3-bea0-4bf2-828e-dd080201aa7c tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.192138 May 26 18:12:47.039513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 459/877] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:46 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:47.956041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:47.956888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:47.975825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:47.976547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:47.977256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:47.977709 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:48.055814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:48.056556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:48.063564 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:48.064123 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:48.064983 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:48.065524 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:48.142478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:48.154532 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:48.156358 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:48.157646 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c42755ff-c717-42d6-aff0-ac41d0bf19cd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.205598 May 26 18:12:48.158249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 419/878] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:47 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:48.220370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:48.228392 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c75f8140-8ac5-4980-801f-dbdb4ebe27f4 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.177281 May 26 18:12:48.228973 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 460/879] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:48 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:49.179062 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:49.180668 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:49.190040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:49.190725 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:49.191462 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:49.191929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:49.245069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:49.245767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:49.256623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:49.257634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:49.270454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:49.271078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:49.276533 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:49.381338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:49.392696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:49.394429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:49.395927 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d761cec-9f7c-4baa-b4b2-ff5de6e9a2b4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.222050 May 26 18:12:49.396427 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 420/880] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:49 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:49.430946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:49.438619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e2625e1-9b0e-45a9-b89d-5f644adefdc8 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.197587 May 26 18:12:49.449443 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 461/881] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:49 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:50.417005 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:50.417629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:50.424217 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:50.424673 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:50.425445 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:50.425888 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:50.456862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:50.457586 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:50.474516 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:50.474976 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:50.475998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:50.476594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:50.612552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:50.622386 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:50.623917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:50.625095 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8429bfe6-62a1-4c45-ab13-d13f1d144c3b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.212547 May 26 18:12:50.625649 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 421/882] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:50 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:50.656854 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:50.669485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5c55dbe1-4375-4620-a948-11da5ca1fc12 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.216219 May 26 18:12:50.670359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 462/883] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:50 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:51.643813 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:51.644491 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:51.651716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.652171 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.653254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.653727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.688259 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:51.689656 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:51.697638 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.698546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.699626 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.700323 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.817746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:51.827987 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:51.829333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:51.830557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-359882e8-30b2-49fc-b08c-4190fa25f740 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.190726 May 26 18:12:51.831332 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 422/884] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:51 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:51.840250 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:51.849050 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a540d2f-5e63-42dc-8696-0b330f632dd5 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.164835 May 26 18:12:51.850031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 463/885] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:51 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:52.856323 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:52.857338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:52.864757 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:52.865351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:52.866913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:52.867441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:52.869431 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:52.870043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:52.876493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:52.877432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:52.877707 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:52.878145 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:53.002874 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:53.011476 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:53.013022 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:53.014266 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b2e69595-ba0b-476a-93d0-53da5959a74d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.162250 May 26 18:12:53.014834 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 423/886] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:52 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:53.015894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:53.023614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4edef50f-12cf-4292-ab39-dbbefc77e713 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.158735 May 26 18:12:53.024185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 464/887] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:52 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:54.033692 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:54.034343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:54.043037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.043668 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.044452 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.044709 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:54.045153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.045331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:54.052522 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.053007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.054432 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.054884 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.205698 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:54.213685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3e8d45e-0ad9-481f-a90c-4e86bffe078f tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1314 microversion: 2.1 time: 0.175771 May 26 18:12:54.214290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 465/888] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:54 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:54.227937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:54.236322 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:54.237817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:54.238994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-60dfb576-fdf2-4ce4-8057-b9b5f2971da4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.209602 May 26 18:12:54.239546 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 424/889] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:54 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:55.231640 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:55.232210 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:55.238650 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.239124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.239879 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.240313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.256765 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:55.257457 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:55.263916 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.264372 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.265152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.265593 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.374877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:55.382438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d053996-c060-4243-81df-6adac592a060 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1499 microversion: 2.1 time: 0.154696 May 26 18:12:55.383028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 466/890] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:55 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:55.401666 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:55.411108 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:55.412633 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:55.414790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-148eb091-fd39-4a36-9448-897514658109 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.161910 May 26 18:12:55.415366 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 425/891] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:55 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:12:55.894410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:55.895037 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:55.901883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.902457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.903652 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.904162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.937873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:12:56.020124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a9bb27e-69ac-4b30-a2d1-e7c42826237e tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 204 len: 0 microversion: 2.1 time: 0.129229 May 26 18:12:56.020989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 467/892] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:12:55 2022] DELETE /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:56.030561 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:56.031400 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:56.038040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.038716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.039422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.039933 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.215309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:56.223155 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b33f1032-21bc-42cc-9f0a-9bb073da413a tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1505 microversion: 2.1 time: 0.196892 May 26 18:12:56.223735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 426/893] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:56 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:56.434210 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:56.434926 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:56.441566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.442025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.442829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.443275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.839919 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:56.848620 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:56.850786 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:56.852168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a6ae9a7d-c1ea-4e2a-9fe0-b3fdf4512d33 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.422232 May 26 18:12:56.852732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 468/894] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:56 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:56.997767 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:56.998305 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:57.003916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-81e27fb9-b6af-4ef0-9745-45c2cfde82ed req-027e7a47-4435-4385-9889-6f3b08aee194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:57.005153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.005614 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.006711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.007256 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.014606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-81e27fb9-b6af-4ef0-9745-45c2cfde82ed req-027e7a47-4435-4385-9889-6f3b08aee194 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.015137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-81e27fb9-b6af-4ef0-9745-45c2cfde82ed req-027e7a47-4435-4385-9889-6f3b08aee194 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.029603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-81e27fb9-b6af-4ef0-9745-45c2cfde82ed req-027e7a47-4435-4385-9889-6f3b08aee194 service nova] Creating event network-changed:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:12:57.034212 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:12:57.035010 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-81e27fb9-b6af-4ef0-9745-45c2cfde82ed req-027e7a47-4435-4385-9889-6f3b08aee194 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036041 May 26 18:12:57.036046 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 469/895] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:57.114854 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d7b68436-26cc-4788-a492-e18efe67a849 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "DELETE /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 204 len: 0 microversion: 2.1 time: 0.120890 May 26 18:12:57.115746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 427/896] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:12:56 2022] DELETE /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:57.124301 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:57.124998 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:57.131388 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.131850 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.132832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.133269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.242399 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:57.243092 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:57.249948 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.250422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.251376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.251837 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.280591 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:57.289708 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9028f5ad-1663-4be9-a871-f992950342e1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.169455 May 26 18:12:57.290321 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 470/897] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:57 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:57.389963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:57.398466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff22d19a-431c-44e9-840b-520cdfd3b8ec tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1505 microversion: 2.1 time: 0.160510 May 26 18:12:57.399133 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 428/898] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:57 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:57.870849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:57.871414 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:57.878371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.878825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.879620 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.880054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:58.014889 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:58.023846 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:58.025332 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:58.026517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e4156a3a-cd31-4d91-8766-d2bb47f1f984 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.159645 May 26 18:12:58.027074 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 471/899] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:57 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:58.307851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:58.308514 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:58.315161 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:58.315618 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:58.316387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:58.316832 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:58.416741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:58.417587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:58.423812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:58.424272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:58.425110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:58.425581 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:58.461146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:58.469352 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c0236742-fd3f-4dd2-8904-711231064946 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1567 microversion: 2.1 time: 0.166136 May 26 18:12:58.470032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 429/900] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:58 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:58.561036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:58.568470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-befac594-4250-49db-81b9-c50fae0511af tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1505 microversion: 2.1 time: 0.156677 May 26 18:12:58.569132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 472/901] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:58 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:59.045995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:59.045995 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:59.053431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.053878 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.054987 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.056209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.410706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.420453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c753cb22-a0ce-4780-a3bc-9769cfe00c12 req-e9816867-321c-4a7b-9f94-f57e79620329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6e1044-c79a-4201-b31d-686b44516f55", "name": "network-vif-deleted", "tag": "cec989f8-be13-49dc-b5fc-f64f60308480"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:59.421913 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.424153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.425344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f54aceb-968a-4512-992c-99da93ea989a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.384039 May 26 18:12:59.426315 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 430/902] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:12:59 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:12:59.431695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c753cb22-a0ce-4780-a3bc-9769cfe00c12 req-e9816867-321c-4a7b-9f94-f57e79620329 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.432157 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c753cb22-a0ce-4780-a3bc-9769cfe00c12 req-e9816867-321c-4a7b-9f94-f57e79620329 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.448226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c753cb22-a0ce-4780-a3bc-9769cfe00c12 req-e9816867-321c-4a7b-9f94-f57e79620329 service nova] Creating event network-vif-deleted:cec989f8-be13-49dc-b5fc-f64f60308480 for instance bc6e1044-c79a-4201-b31d-686b44516f55 on hv-cinder-83906 May 26 18:12:59.453390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c753cb22-a0ce-4780-a3bc-9769cfe00c12 req-e9816867-321c-4a7b-9f94-f57e79620329 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036923 May 26 18:12:59.454185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 473/903] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:59.543829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:59.544462 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:59.550449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.550902 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.551679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.552128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.587578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:59.588281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:59.595095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.595549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.596310 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.596764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.624800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.633441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-253befe1-443f-4342-a6d9-d868d03b7a1d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1500 microversion: 2.1 time: 0.093461 May 26 18:12:59.634344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 431/904] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:59 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1500 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:59.667679 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.676151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b420a5d2-7a28-424f-b114-ef5cf9cb9b81 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1463 microversion: 2.1 time: 0.093736 May 26 18:12:59.686479 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 474/905] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:12:59 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1463 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:59.734785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3068a660-eb68-44e5-a4df-3568e4b9bc3b req-c0f44ff2-c5ad-4aac-987f-e1f052250c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65c23bc-71b7-44d4-a970-a8194641fa7c", "name": "network-vif-deleted", "tag": "0ef2d923-5be7-4253-9dc6-70dcd9c2269d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:59.743976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3068a660-eb68-44e5-a4df-3568e4b9bc3b req-c0f44ff2-c5ad-4aac-987f-e1f052250c07 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:59.744424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3068a660-eb68-44e5-a4df-3568e4b9bc3b req-c0f44ff2-c5ad-4aac-987f-e1f052250c07 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:59.757004 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3068a660-eb68-44e5-a4df-3568e4b9bc3b req-c0f44ff2-c5ad-4aac-987f-e1f052250c07 service nova] Creating event network-vif-deleted:0ef2d923-5be7-4253-9dc6-70dcd9c2269d for instance d65c23bc-71b7-44d4-a970-a8194641fa7c on hv-cinder-83906 May 26 18:12:59.761997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3068a660-eb68-44e5-a4df-3568e4b9bc3b req-c0f44ff2-c5ad-4aac-987f-e1f052250c07 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 May 26 18:12:59.762825 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 432/906] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:00.445222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:00.445777 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:00.451797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.452242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.453001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.453433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.584027 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.593022 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.594564 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.595736 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d4eda7d-27ca-47f6-b328-0e655fa20eb9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.155090 May 26 18:13:00.596316 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 475/907] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:00 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:00.652792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:00.653494 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:00.659866 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.660316 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.661078 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.661524 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.681104 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:00.693808 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:00.694470 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:00.700922 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.701313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.702096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:00.702567 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:00.729309 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.736830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a1487318-1c9d-4033-9d4e-5fe687167aa4 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1500 microversion: 2.1 time: 0.089968 May 26 18:13:00.737398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 433/908] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:00 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1500 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:00.764348 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.772548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13a4e820-da7c-4c30-adde-7096de5adb2b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1463 microversion: 2.1 time: 0.081903 May 26 18:13:00.773215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 476/909] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:00 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1463 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:01.614894 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:01.615579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:01.621613 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.622062 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.622853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.623287 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.753474 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:01.754097 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:01.754591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.761328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.761766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.762573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.763018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.763601 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.765099 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.766485 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7969d164-f507-417a-aee1-49da776f3a3f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.155504 May 26 18:13:01.767055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 434/910] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:01 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:01.782571 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:01.792324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:01.792938 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:01.799054 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.799505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.800275 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:01.800710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:01.829557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.838171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3fc18d7-d3a9-4e22-9ce5-f0508ec4a34d tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1219 microversion: 2.1 time: 0.088472 May 26 18:13:01.838775 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 477/911] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:01 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:01.866407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.874074 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d28c42fa-8471-499a-8be9-07088aa5b553 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1463 microversion: 2.1 time: 0.086159 May 26 18:13:01.874736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 435/912] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:01 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:02.785335 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:02.785937 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:02.793641 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.794128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.796311 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.797270 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.856190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:02.856806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:02.863317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.863764 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.864532 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.864969 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.928613 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:02.928961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:02.937940 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:02.938116 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-804de82b-15e7-40b3-8837-4f9cffa9caa1 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1219 microversion: 2.1 time: 0.085540 May 26 18:13:02.939067 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 436/913] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:02 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:02.940358 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:02.942093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d1f44bc-1fac-4211-ba42-4390a619d807 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.160373 May 26 18:13:02.943424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 478/914] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:02 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:02.952023 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:02.952645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:02.960584 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.960734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.961506 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.962140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.996564 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:02.997084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:02.997531 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lazy-loading 'fault' on Instance uuid d65c23bc-71b7-44d4-a970-a8194641fa7c {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:03.042550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:03.051327 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7034a2f7-7287-4e93-ab5b-7951ffce1809 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1304 microversion: 2.1 time: 0.111089 May 26 18:13:03.051907 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 437/915] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:02 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:03.956399 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:03.957047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [instance: bc6e1044-c79a-4201-b31d-686b44516f55] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:03.960656 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:03.961814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:03.963820 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.964274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:03.965347 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.965485 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:03.968464 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.969101 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:03.969900 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.970374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.000678 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.001404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.002128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Lazy-loading 'fault' on Instance uuid bc6e1044-c79a-4201-b31d-686b44516f55 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:04.060584 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ba168683a4433f8a763cb4c250c9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cf8fb59b4f4b12900d336f1d91b1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.069246 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e886f347-c094-4436-a9d3-1a38fbfe5f3f tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55" status: 200 len: 1304 microversion: 2.1 time: 0.117267 May 26 18:13:04.070486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 479/916] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:03 2022] GET /compute/v2.1/servers/bc6e1044-c79a-4201-b31d-686b44516f55 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:04.075758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:04.076648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:04.083737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.084727 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.086212 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.086921 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.137701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.138166 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.138675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lazy-loading 'fault' on Instance uuid d65c23bc-71b7-44d4-a970-a8194641fa7c {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:04.142781 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.155301 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.157114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.158914 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6b59e07e-4929-4c8e-aca9-6e0b4759bca3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.201849 May 26 18:13:04.159647 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 438/917] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:03 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:13:04.218090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98003818ed84c9b8e2301467edebdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6217142c97d54164a23b27dafacd083f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.226350 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec3f06f5-6ac6-4319-96bf-1c2adf0bc48b tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 200 len: 1304 microversion: 2.1 time: 0.154491 May 26 18:13:04.226941 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 480/918] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:04 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:04.325609 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d6b3322-94c2-490c-ab9b-f1b79f474362 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] Calling method '.version_select at 0x7f1fa03a9c10>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:04.328861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d6b3322-94c2-490c-ab9b-f1b79f474362 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [969898f2-4271-4f0d-8958-91ef4bc8b8b0] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:13:05.179925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:05.180548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:05.187297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.187760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:05.188587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.189100 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:05.324164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:05.332611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:05.334120 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:05.336168 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d73207a-2356-4a1a-b0fe-04dc6445a116 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.160384 May 26 18:13:05.336734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 481/919] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:05 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:13:05.337254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d6b3322-94c2-490c-ab9b-f1b79f474362 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] [969898f2-4271-4f0d-8958-91ef4bc8b8b0] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 40176. May 26 18:13:05.341094 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:05.341701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] [instance: d65c23bc-71b7-44d4-a970-a8194641fa7c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:05.347660 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.348119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:05.348883 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.349331 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:05.363509 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] HTTP exception thrown: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Request method failure captured: May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c HTTP/1.1 May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8MCNZtx8vqAXWDLCnUoMjWA0FSt74KxB6M-IAfaE0hRNbyZ-dmQha6330Fy0gKDnrMaQUm-f4QXZiM4cILMqW_P4pNSRYp7svonWQImvE3Z8LGjuKi8KXYBotW-vEYPCr51ayU18ykiCtZzPd9PB64oYOds6vkb5VrqyQpG5Ow_hpA May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 6217142c97d54164a23b27dafacd083f May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-1154299485 May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:13:05.365223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6217142c97d54164a23b27dafacd083f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6217142c97d54164a23b27dafacd083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6217142c97d54164a23b27dafacd083f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6217142c97d54164a23b27dafacd083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-1154299485 May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6217142c97d54164a23b27dafacd083f May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-1154299485 May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-1154299485-project May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: e98003818ed84c9b8e2301467edebdd6 May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-1154299485-project May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. May 26 18:13:05.367602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd65c23bc-71b7-44d4-a970-a8194641fa7c'} May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:05.368426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. May 26 18:13:05.369823 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:13:05.371171 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0d6b3322-94c2-490c-ab9b-f1b79f474362 tempest-TestShelveInstance-1369247442 tempest-TestShelveInstance-1369247442-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-565443525" status: 202 len: 0 microversion: 2.1 time: 1.043634 May 26 18:13:05.371281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] Returning 404 to user: Instance d65c23bc-71b7-44d4-a970-a8194641fa7c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:05.371411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 439/920] 10.222.0.76 () {58 vars in 1250 bytes} [Thu May 26 18:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-565443525 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:13:05.371513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4026a75-5fac-4d31-82c3-334c8b56df77 tempest-VolumesActionsTest-1154299485 tempest-VolumesActionsTest-1154299485-project] 10.222.0.76 "GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c" status: 404 len: 111 microversion: 2.1 time: 0.029378 May 26 18:13:05.371513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 482/921] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:05 2022] GET /compute/v2.1/servers/d65c23bc-71b7-44d4-a970-a8194641fa7c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:13:05.881045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-480686062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-17761177", "security_groups": [{"name": "tempest-secgroup-smoke-1733973357"}], "block_device_mapping_v2": [{"uuid": "a65370ab-0da1-409c-84b1-cd6f1e9f14e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ba39add-f4a7-4061-91a5-b356a25c19cf"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:06.029032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] validate_networks() for [('8ba39add-f4a7-4061-91a5-b356a25c19cf', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:13:06.153291 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-57bc69b2-5909-497d-8420-18f6cee6165a req-aa33e5ce-048c-4ad8-97ba-cf2cf074a975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "name": "network-vif-plugged", "status": "completed", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:06.159460 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:06.165686 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-57bc69b2-5909-497d-8420-18f6cee6165a req-aa33e5ce-048c-4ad8-97ba-cf2cf074a975 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:06.166771 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-57bc69b2-5909-497d-8420-18f6cee6165a req-aa33e5ce-048c-4ad8-97ba-cf2cf074a975 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.188232 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-57bc69b2-5909-497d-8420-18f6cee6165a req-aa33e5ce-048c-4ad8-97ba-cf2cf074a975 service nova] Creating event network-vif-plugged:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:13:06.196247 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-57bc69b2-5909-497d-8420-18f6cee6165a req-aa33e5ce-048c-4ad8-97ba-cf2cf074a975 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047450 May 26 18:13:06.197689 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 483/922] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:06.355309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:06.356189 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:06.362916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:06.363377 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.364164 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:06.364619 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.500561 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:13:06.501133 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:13:06.501887 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:13:06.502540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:13:06.503239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:13:06.513180 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:06.513716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.514624 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:06.515132 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.539392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:06.544197 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Getting quotas for user 42c96a85400941818b658cca8cb56fec and project 45d94db7075c40cbae3f106a9661d969. Resources: {'ram', 'instances', 'cores'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:06.614452 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:13:06.617572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a65370ab-0da1-409c-84b1-cd6f1e9f14e2',volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:13:06.628553 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:06.642380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:06.643961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:06.645171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d73b51e9-e474-4069-a1d8-148a9b97dddf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.294119 May 26 18:13:06.646052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 484/923] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:06 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:13:06.765746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3ce88185-f92d-4554-a844-8258748033a9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888563 May 26 18:13:06.766530 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 440/924] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:13:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:13:06.776814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-647e0b8b-dd1c-4322-b004-ed8c48cb00e1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:06.777703 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-647e0b8b-dd1c-4322-b004-ed8c48cb00e1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:06.853395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-647e0b8b-dd1c-4322-b004-ed8c48cb00e1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:06.861174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-647e0b8b-dd1c-4322-b004-ed8c48cb00e1 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1092 microversion: 2.1 time: 0.088189 May 26 18:13:06.871599 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 485/925] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:06 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1092 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:07.666693 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:07.668434 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:07.681717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.682628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.683582 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.684134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.842478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:07.853051 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:07.854613 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:07.855817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc62cd07-65f0-40bd-ba1b-f989c225b604 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.194147 May 26 18:13:07.856417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 441/926] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:07 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:07.879728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:07.880361 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:07.887671 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.888107 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.888887 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.889329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.963433 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:07.971775 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7e2af30-99aa-41b1-9e4e-f5b9ee2ba0a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1142 microversion: 2.1 time: 0.096129 May 26 18:13:07.972348 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 486/927] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:07 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1142 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:08.874667 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:08.876165 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:08.886734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:08.887299 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:08.888248 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:08.888966 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:08.989532 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:08.991467 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:08.998275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:08.998744 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:08.999576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:09.000006 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:09.065172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:09.072991 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-efd9bfb0-0955-4c08-9c80-8e8dee4ef819 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1142 microversion: 2.1 time: 0.087330 May 26 18:13:09.073562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 487/928] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:08 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:09.169069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:09.177558 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:09.179818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:09.181095 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e02c3664-faa4-4b95-a207-2027c5c29512 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.310408 May 26 18:13:09.181739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 442/929] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:08 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:10.090914 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:10.093051 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:10.102724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.103588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.104646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.105337 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.180905 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:10.188933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc8b434b-4ea2-426b-a204-c7d53a050e54 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1190 microversion: 2.1 time: 0.103366 May 26 18:13:10.189861 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 488/930] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:10 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:10.205304 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:10.206396 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:10.209447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.216482 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.217029 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.218075 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.218554 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.471748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:10.483884 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:10.486056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:10.488137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-40c748e4-7bb7-4fce-bd55-ead378e6ed34 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.291636 May 26 18:13:10.488815 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 443/931] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:10 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:11.215055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:11.215722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:11.226080 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.226942 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.227959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.228576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.355082 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:11.370068 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-735b622f-5a12-41ed-88d5-13105f8230fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1208 microversion: 2.1 time: 0.161026 May 26 18:13:11.381438 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 489/932] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:11 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:11.511130 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:11.515354 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:11.522808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.523265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.547931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.553893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.843367 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:11.855698 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:11.860358 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:11.864061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-36524163-35c8-452e-bccc-5d4f13a064a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.358693 May 26 18:13:11.864721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 444/933] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:11 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:12.394162 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:12.396021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:12.411869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.415128 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.422588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.423423 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.884806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:12.885441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:12.899555 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.904444 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.908575 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.910294 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.096116 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.107069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-649e30c0-9263-46fa-a3e5-12a4e891c5ff tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.721343 May 26 18:13:13.107801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 490/934] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:12 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:13.331830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.358062 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.414773 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.416026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e9acede0-290c-4d1d-8346-7c7b42e5174e tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1806 microversion: 2.20 time: 0.536330 May 26 18:13:13.428808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 445/935] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:12 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1806 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:14.111152 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-42f0e953-f54a-4d9b-838a-e101eade8917 req-e77b333a-8391-4a37-832e-ff0cd9ead77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85ca5fa-25c1-48a0-abb3-6e2198a1cda1", "tag": "f80146df-c3ab-4dc2-926f-34412d539bbd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:14.125959 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:14.127706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:14.136577 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.141265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.149156 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.149749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.158827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-42f0e953-f54a-4d9b-838a-e101eade8917 req-e77b333a-8391-4a37-832e-ff0cd9ead77d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.160384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-42f0e953-f54a-4d9b-838a-e101eade8917 req-e77b333a-8391-4a37-832e-ff0cd9ead77d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.179167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-42f0e953-f54a-4d9b-838a-e101eade8917 req-e77b333a-8391-4a37-832e-ff0cd9ead77d service nova] Creating event network-changed:f80146df-c3ab-4dc2-926f-34412d539bbd for instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 on hv-cinder-83906 May 26 18:13:14.188192 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-42f0e953-f54a-4d9b-838a-e101eade8917 req-e77b333a-8391-4a37-832e-ff0cd9ead77d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083437 May 26 18:13:14.189398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 491/936] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:14.458670 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:14.460614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:14.470362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.471120 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.479832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.480468 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.539402 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:14.558137 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2f7191b3-62e6-4e1c-92a7-e44e4c0d8128 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.435750 May 26 18:13:14.561061 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 446/937] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:14 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:14.783004 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:14.804683 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:14.809303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:14.812191 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d85091b5-9acb-474d-ae32-eedb7f2d6d4d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1793 microversion: 2.20 time: 0.363331 May 26 18:13:14.813647 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 492/938] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:14 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1793 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:15.576739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:15.577355 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:15.590449 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:15.591450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:15.592672 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:15.593455 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:15.900650 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:15.913642 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3a7fe58f-f6f6-4330-9271-cf42ea060184 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.339179 May 26 18:13:15.914862 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 447/939] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:15 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:16.931865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:16.932855 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:16.935125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:16.941306 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:16.942028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:16.942896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:16.944370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.117397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:17.129167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4b57b0e7-cbc0-44f7-9860-44ac7909a6ee tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.201431 May 26 18:13:17.129167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 493/940] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:16 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:18.143624 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:18.145977 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:18.155645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:18.156711 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:18.166446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.167946 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:18.168824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.169335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:18.342956 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:18.351431 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3e596eee-0862-4499-9155-242532afd828 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.208894 May 26 18:13:18.352295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 448/941] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:18 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:19.374898 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:19.376134 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:19.388292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:19.389023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:19.390112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:19.390596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:19.580669 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:19.589856 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0b928162-c287-4925-a241-039a1fa68db3 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.223271 May 26 18:13:19.590829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 494/942] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:19 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:20.617302 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:20.619718 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:20.631330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.632535 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.634120 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.635141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.847253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:20.866039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d31d1e69-2286-4be1-b0ad-4eddc5745e7a tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.261649 May 26 18:13:20.866623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 449/943] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:20 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:21.883410 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:21.883975 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:21.890910 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.891371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.892165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.892607 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.051322 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:22.063167 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5a8bb00a-6384-41bc-9e91-94f85d073aca tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.184137 May 26 18:13:22.064213 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 495/944] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:21 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:23.080612 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:23.081301 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:23.090926 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:23.091710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:23.092679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:23.093377 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:23.259654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:23.267594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d512ca4e-cb80-494f-a429-0e13eeef61a2 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.190921 May 26 18:13:23.277480 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 450/945] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:23 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:24.285007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:24.285965 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:24.294127 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.294946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.296558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.297400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.322336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:24.469648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:24.480033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bd4a2c54-e5f4-4842-877d-5f514cdf0a00 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.198712 May 26 18:13:24.484083 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 496/946] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:24 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:24.564146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-c1cef54f-c732-4b9a-8f65-0dc174165acf req-f9fa8229-ac4d-447d-9764-8a23e3e01603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85ca5fa-25c1-48a0-abb3-6e2198a1cda1", "name": "network-vif-plugged", "status": "completed", "tag": "f80146df-c3ab-4dc2-926f-34412d539bbd"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:24.584663 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c1cef54f-c732-4b9a-8f65-0dc174165acf req-f9fa8229-ac4d-447d-9764-8a23e3e01603 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.585424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-c1cef54f-c732-4b9a-8f65-0dc174165acf req-f9fa8229-ac4d-447d-9764-8a23e3e01603 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.611697 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-c1cef54f-c732-4b9a-8f65-0dc174165acf req-f9fa8229-ac4d-447d-9764-8a23e3e01603 service nova] Creating event network-vif-plugged:f80146df-c3ab-4dc2-926f-34412d539bbd for instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 on hv-cinder-83906 May 26 18:13:24.617829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-c1cef54f-c732-4b9a-8f65-0dc174165acf req-f9fa8229-ac4d-447d-9764-8a23e3e01603 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059376 May 26 18:13:24.619258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 451/947] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:25.500896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:25.501764 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:25.512155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:25.513029 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:25.514114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:25.514818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:25.685397 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:25.695691 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d953f081-c67b-43ba-ba81-a47aef15b614 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1264 microversion: 2.1 time: 0.198621 May 26 18:13:25.696298 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 497/948] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:25 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:26.714433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:26.715154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:26.722047 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.722539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:26.723334 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.723780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:26.728966 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:26.891091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:26.910917 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1cf6af74-21b4-44fc-80c1-6d9c7e91645e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1452 microversion: 2.1 time: 0.201380 May 26 18:13:26.911632 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 452/949] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:26 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:26.935059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:26.935693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:26.944329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.944799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:26.945602 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.946269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:27.171805 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:27.184076 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83cfb1df-0e35-4df7-8fd6-3623858acbcb tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1452 microversion: 2.1 time: 0.252545 May 26 18:13:27.185254 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 498/950] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:26 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1452 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:29.813692 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-8e100070-7c47-4193-8cab-a2334fa852f2 req-7aaa4f86-378e-46b2-b343-09f63cd7ea69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85ca5fa-25c1-48a0-abb3-6e2198a1cda1", "tag": "f80146df-c3ab-4dc2-926f-34412d539bbd"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:29.828404 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8e100070-7c47-4193-8cab-a2334fa852f2 req-7aaa4f86-378e-46b2-b343-09f63cd7ea69 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:29.828963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8e100070-7c47-4193-8cab-a2334fa852f2 req-7aaa4f86-378e-46b2-b343-09f63cd7ea69 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:29.842944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-8e100070-7c47-4193-8cab-a2334fa852f2 req-7aaa4f86-378e-46b2-b343-09f63cd7ea69 service nova] Creating event network-changed:f80146df-c3ab-4dc2-926f-34412d539bbd for instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 on hv-cinder-83906 May 26 18:13:29.848330 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-8e100070-7c47-4193-8cab-a2334fa852f2 req-7aaa4f86-378e-46b2-b343-09f63cd7ea69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039035 May 26 18:13:29.849696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 453/951] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:35.107153 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-976952019", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "networks": [{"uuid": "99892cad-2ee2-484d-9d46-3d47317062eb"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:35.160144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] validate_networks() for [('99892cad-2ee2-484d-9d46-3d47317062eb', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:13:35.518075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:13:35.518528 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:13:35.519026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:13:35.519423 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:13:35.519822 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:13:35.529566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.530021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.530849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.531290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.549303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Getting quotas for project fd9dfeec33544d148b87d188b4208835. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:35.553417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Getting quotas for user a461e083aa424e1dbf1acc0b68b4b1df and project fd9dfeec33544d148b87d188b4208835. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:35.565269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:13:35.568222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:13:35.614951 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2248b96-65c3-469b-a3fc-2c712eb765af tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511350 May 26 18:13:35.615494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 499/952] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:13:35.626548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0e78d815-71e1-451e-868b-dd3745ecf083 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:35.627262 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0e78d815-71e1-451e-868b-dd3745ecf083 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:35.689435 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e78d815-71e1-451e-868b-dd3745ecf083 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:35.698641 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0e78d815-71e1-451e-868b-dd3745ecf083 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1218 microversion: 2.1 time: 0.076671 May 26 18:13:35.699475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 454/953] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:35 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:36.719981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:36.720575 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:36.722576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:36.728782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.729237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.730160 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.730663 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.800918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:36.809682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69b41c8c-80ad-4e1f-9127-1002f89b2079 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1278 microversion: 2.1 time: 0.094020 May 26 18:13:36.810561 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 500/954] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:36 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:37.826644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:37.827274 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:37.835446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:37.835901 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:37.836683 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:37.837145 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.055721 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:38.063142 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0308bc20-8e1b-41a1-9989-39bd1d96d8a5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.240383 May 26 18:13:38.063716 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 455/955] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:37 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:38.195617 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3afe2b8e-0469-4b1b-9be2-e421752a5014 req-61faa5dd-388c-4e39-a7ab-7574687d2b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d777e891-39fc-40a2-9e37-11ea2f519575", "tag": "5f54c3b5-d7b5-4be9-9468-da72b838cb66"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:38.205176 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3afe2b8e-0469-4b1b-9be2-e421752a5014 req-61faa5dd-388c-4e39-a7ab-7574687d2b71 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:38.205624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3afe2b8e-0469-4b1b-9be2-e421752a5014 req-61faa5dd-388c-4e39-a7ab-7574687d2b71 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.226244 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3afe2b8e-0469-4b1b-9be2-e421752a5014 req-61faa5dd-388c-4e39-a7ab-7574687d2b71 service nova] Creating event network-changed:5f54c3b5-d7b5-4be9-9468-da72b838cb66 for instance d777e891-39fc-40a2-9e37-11ea2f519575 on hv-cinder-83906 May 26 18:13:38.226244 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3afe2b8e-0469-4b1b-9be2-e421752a5014 req-61faa5dd-388c-4e39-a7ab-7574687d2b71 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030960 May 26 18:13:38.226244 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 501/956] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:39.081305 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:39.081963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:39.089440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.089962 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.090701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.091140 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.225620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:39.233075 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-97f53e94-5e7a-4f33-8bd3-6223e7ffc7cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.155721 May 26 18:13:39.233644 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 456/957] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:39 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:40.250926 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:40.251624 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:40.258568 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:40.259019 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:40.259781 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:40.260226 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:40.393853 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:40.402132 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20c516ef-b84a-4009-85d9-a7b110c60c2c tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.155651 May 26 18:13:40.402728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 502/958] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:40 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:41.419912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:41.420458 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:41.422534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=30 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:41.428749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:41.429209 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:41.429986 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:41.430463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:41.566729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:41.574299 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-29170f2e-a7f9-4c8f-ba48-cccba8bd1291 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.159046 May 26 18:13:41.574868 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 457/959] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:41 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:42.595257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:42.595881 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:42.602487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:42.602948 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:42.603728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:42.604174 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:42.622039 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-83b130c5-f645-4a9f-a9a0-0e7d3bf5c36f req-e31ec56c-dad6-4c3c-9290-a548b4d7cf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d777e891-39fc-40a2-9e37-11ea2f519575", "name": "network-vif-plugged", "status": "completed", "tag": "5f54c3b5-d7b5-4be9-9468-da72b838cb66"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:42.632236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-83b130c5-f645-4a9f-a9a0-0e7d3bf5c36f req-e31ec56c-dad6-4c3c-9290-a548b4d7cf19 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:42.632788 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-83b130c5-f645-4a9f-a9a0-0e7d3bf5c36f req-e31ec56c-dad6-4c3c-9290-a548b4d7cf19 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:42.645274 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-83b130c5-f645-4a9f-a9a0-0e7d3bf5c36f req-e31ec56c-dad6-4c3c-9290-a548b4d7cf19 service nova] Creating event network-vif-plugged:5f54c3b5-d7b5-4be9-9468-da72b838cb66 for instance d777e891-39fc-40a2-9e37-11ea2f519575 on hv-cinder-83906 May 26 18:13:42.650960 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-83b130c5-f645-4a9f-a9a0-0e7d3bf5c36f req-e31ec56c-dad6-4c3c-9290-a548b4d7cf19 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 May 26 18:13:42.652257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 458/960] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:42.744353 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:42.751990 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6562c8e4-eac8-42cc-81d7-84fd3c601405 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.160567 May 26 18:13:42.752570 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 503/961] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:42 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:43.771497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:43.772208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:43.779128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:43.779578 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:43.780363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:43.780806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:43.917935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:43.925521 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af63c604-e853-4825-97b9-1c3bef35e3f0 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1318 microversion: 2.1 time: 0.159475 May 26 18:13:43.926088 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 459/962] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:43 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:44.942371 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:44.942963 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:44.949590 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:44.950040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:44.950835 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:44.951273 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:45.084222 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:45.091923 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3691f133-a851-4355-ba54-c8743ac904e6 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1508 microversion: 2.1 time: 0.153455 May 26 18:13:45.092492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 504/963] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:13:44 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:48.728298 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:48.728863 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:48.731433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:48.737272 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.737728 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.738539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.739524 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.780414 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3b1fc1df-a292-4936-95d8-ef8ef336d003 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments/3f568412-fed4-4a58-b0f6-f3c6c416ce1b" status: 200 len: 194 microversion: 2.20 time: 0.056413 May 26 18:13:48.781902 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 460/964] 10.222.0.76 () {60 vars in 1453 bytes} [Thu May 26 18:13:48 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments/3f568412-fed4-4a58-b0f6-f3c6c416ce1b => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:13:48.845627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:48.846223 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:48.848087 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:48.849245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:48.855461 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.855924 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.856706 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.857150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.940362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lazy-loading 'services' on Instance uuid 6fabdc26-1a43-41bd-849f-797ba0e5b73b {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:49.019093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-22e8aa65-b4b4-45f3-9bca-5592160396be tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments/3f568412-fed4-4a58-b0f6-f3c6c416ce1b" status: 202 len: 0 microversion: 2.20 time: 0.177202 May 26 18:13:49.019724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 505/965] 10.222.0.76 () {60 vars in 1456 bytes} [Thu May 26 18:13:48 2022] DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments/3f568412-fed4-4a58-b0f6-f3c6c416ce1b => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:13:49.028591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:49.029484 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:49.035566 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:49.037274 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:49.038021 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:49.038512 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:49.068442 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-df0c390e-b593-4832-81a7-6d94f67a1ef8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044165 May 26 18:13:49.069034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 461/966] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 26 18:13:49 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:13:50.082149 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:50.083239 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:50.089548 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:50.090011 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:50.090821 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:50.091265 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:50.121136 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a67130cc-cfeb-41ee-b9e9-1e123798be63 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 May 26 18:13:50.121713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 506/967] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 26 18:13:50 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:13:51.134081 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:51.135160 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:51.147382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.148567 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.151255 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.152278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.188324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-64529d69-bd9d-410f-bf61-185abc0cb4e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059056 May 26 18:13:51.188893 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 462/968] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 26 18:13:51 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:51.246859 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:51.247413 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:51.253994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.255110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.255766 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.256207 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.282024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:13:51.356603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8935edc0-31fd-4a91-8c6c-430296ea7281 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 204 len: 0 microversion: 2.20 time: 0.113341 May 26 18:13:51.357194 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 507/969] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 26 18:13:51 2022] DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:13:51.365806 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:51.366463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:51.372418 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.372872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.373645 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.374110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.514786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:51.523259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:51.524768 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:51.525919 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-913fa419-c3bb-4db4-91b0-417ea5dcf122 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.164335 May 26 18:13:51.526772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 463/970] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:51 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:13:52.545325 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:52.546061 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:52.552566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:52.553016 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:52.553782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:52.554241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:52.696374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:52.704471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:52.706095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:52.707299 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c59830b0-0c36-4c47-9a4d-7cef8fa2be22 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.166321 May 26 18:13:52.708605 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 508/971] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:52 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:53.727134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:53.727681 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:53.734146 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:53.734631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:53.735417 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:53.735860 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:53.985517 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:53.994804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:53.998795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:54.001603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-48497a36-98ef-4e00-99f5-d5e6770fa477 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 200 len: 1721 microversion: 2.20 time: 0.278679 May 26 18:13:54.002787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 464/972] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:53 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:13:54.374949 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-83c2dd20-797c-40bd-bc90-f67c7ec71557 req-1cfce92d-88a1-4aa9-a8ef-8b2ab84b39e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fabdc26-1a43-41bd-849f-797ba0e5b73b", "name": "network-vif-deleted", "tag": "e80236d7-3451-479e-a7ef-7dbe6285a877"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:54.386614 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-83c2dd20-797c-40bd-bc90-f67c7ec71557 req-1cfce92d-88a1-4aa9-a8ef-8b2ab84b39e4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:54.387290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-83c2dd20-797c-40bd-bc90-f67c7ec71557 req-1cfce92d-88a1-4aa9-a8ef-8b2ab84b39e4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:54.390363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:54.403297 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-83c2dd20-797c-40bd-bc90-f67c7ec71557 req-1cfce92d-88a1-4aa9-a8ef-8b2ab84b39e4 service nova] Creating event network-vif-deleted:e80236d7-3451-479e-a7ef-7dbe6285a877 for instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b on hv-cinder-83906 May 26 18:13:54.408898 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-83c2dd20-797c-40bd-bc90-f67c7ec71557 req-1cfce92d-88a1-4aa9-a8ef-8b2ab84b39e4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037301 May 26 18:13:54.410146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 509/973] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:55.023525 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:55.025273 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:55.040829 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:55.041603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:55.042616 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:55.043351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:55.060207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b HTTP/1.1 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:13:55.061952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:13:55.063831 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '6fabdc26-1a43-41bd-849f-797ba0e5b73b'} May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:55.064738 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:13:55.066176 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:13:55.067704 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:55.067704 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-36d9f040-c052-47e4-a927-5e55e61f00fb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 404 len: 111 microversion: 2.20 time: 0.045962 May 26 18:13:55.067704 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 465/974] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:55 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 18:13:55.074023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-26a69f86-14f3-4020-8bd3-391ec7fa3b4f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '.version_select at 0x7f1fa04600d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:55.091526 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-26a69f86-14f3-4020-8bd3-391ec7fa3b4f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964452170" status: 204 len: 0 microversion: 2.20 time: 0.022500 May 26 18:13:55.092272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 510/975] 10.222.0.76 () {60 vars in 1258 bytes} [Thu May 26 18:13:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964452170 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:13:56.043686 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9ef8cb36-e0a6-472f-ab0f-ac7d22b5884b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: .version_select at 0x7f1fa0392940>, body: {"keypair": {"name": "tempest-keypair-1660816782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyYicifMuMXtYOxZzSMoysd+Lejf1ToDlajbDKPlEFJRc+qhy4OfIVVDgzR5MKq/GHvIvCII+9tiH5zJEqN6PihTETRYtwKOrxRa2SUby+YdtBlHwTgZ+KUtYYTBSkOYg=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:56.059446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9ef8cb36-e0a6-472f-ab0f-ac7d22b5884b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:56.063241 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9ef8cb36-e0a6-472f-ab0f-ac7d22b5884b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for user 1b262e67242c4384ba5bf0356a08679e and project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:56.085843 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9ef8cb36-e0a6-472f-ab0f-ac7d22b5884b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045987 May 26 18:13:56.086466 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 466/976] 10.222.0.76 () {62 vars in 1199 bytes} [Thu May 26 18:13:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:13:57.448544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1512723692", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb5c7d1-b856-499c-9d5b-edcdfcd226bf"}], "security_groups": [{"name": "tempest-securitygroup--1662289593"}], "key_name": "tempest-keypair-1660816782", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:57.551007 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] validate_networks() for [('bdb5c7d1-b856-499c-9d5b-edcdfcd226bf', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:13:57.918309 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:13:57.918749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:13:57.919227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:13:57.919675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:13:57.920098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:13:57.929692 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:57.930144 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:57.930980 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:57.931448 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:57.950556 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:57.954566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Getting quotas for user 1b262e67242c4384ba5bf0356a08679e and project 1b13e82b890d4bedbd8ecb6bcbd603c6. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:57.966369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:13:57.968741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:13:58.014618 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e210d6b-f7bf-44e1-92c3-38469c2c64e6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.570495 May 26 18:13:58.015386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 511/977] 10.222.0.76 () {62 vars in 1187 bytes} [Thu May 26 18:13:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 18:13:58.026752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:58.027376 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:58.085804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:58.096107 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:58.097516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:58.099228 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b7d15ad5-83c1-4830-a2ea-eeef3fd87bcf tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1282 microversion: 2.20 time: 0.076930 May 26 18:13:58.099994 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 467/978] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:58 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:13:59.119008 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:59.120275 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:59.126827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:59.127281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:59.128047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:59.128676 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:59.200844 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:59.209587 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:59.211137 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:59.212273 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d1f90f3-beca-46ba-b433-c2ac51fe18cb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1352 microversion: 2.20 time: 0.099287 May 26 18:13:59.213026 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 512/979] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:13:59 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:00.231306 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:00.232190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:00.239629 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:00.240350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:00.241239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:00.241626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:00.246335 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=65 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:00.452544 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:00.462969 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:00.464696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:00.466015 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dc3ea1c2-fe15-4513-8503-5e24e54af5da tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.238634 May 26 18:14:00.466715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 468/980] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:00 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:00.666763 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3b5a5c3f-0a4d-4cce-8966-59b2f66969fa req-dde8230c-49df-4b1f-afef-c33e02093f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:00.679003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3b5a5c3f-0a4d-4cce-8966-59b2f66969fa req-dde8230c-49df-4b1f-afef-c33e02093f29 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:00.679381 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3b5a5c3f-0a4d-4cce-8966-59b2f66969fa req-dde8230c-49df-4b1f-afef-c33e02093f29 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:00.690862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3b5a5c3f-0a4d-4cce-8966-59b2f66969fa req-dde8230c-49df-4b1f-afef-c33e02093f29 service nova] Creating event network-changed:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:14:00.697490 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3b5a5c3f-0a4d-4cce-8966-59b2f66969fa req-dde8230c-49df-4b1f-afef-c33e02093f29 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035252 May 26 18:14:00.698096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 513/981] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:01.484964 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:01.485523 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:01.492493 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:01.492937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:01.493696 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:01.494127 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:01.631540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:01.639553 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:01.641079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:01.642276 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-87122e1d-ccd4-44b6-80b6-e211feec8b2f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.161208 May 26 18:14:01.642864 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 469/982] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:01 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:02.360395 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c2b82c-dcd6-421b-8472-04f43479ce72", "device": "/dev/sdb"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:02.362457 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:02.369785 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:02.370274 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:02.371053 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:02.371527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:02.625773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75fc6481-6f5e-40a9-aa22-78d2d6c36399 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "POST /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269638 May 26 18:14:02.626418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 514/983] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:14:02 2022] POST /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:02.661673 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:02.662315 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:02.669776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:02.670239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:02.671019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:02.671631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:02.806579 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:02.814586 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:02.816158 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:02.817713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d30806a-08f0-44b9-b7a9-604c623fddac tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.160570 May 26 18:14:02.818295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 470/984] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:02 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:03.837133 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:03.837827 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:03.844104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:03.844551 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:03.845333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:03.845767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:03.981023 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:03.989590 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:03.991138 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:03.992245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13e6108c-c96e-4c59-a1c4-759fa2bb3ed3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.160033 May 26 18:14:03.992801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 515/985] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:03 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:05.010222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:05.010848 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:05.017452 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:05.017904 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:05.018701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:05.019144 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:05.159935 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:05.168513 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:05.170034 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:05.171185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25e5c683-54ef-4454-91d1-c546b0c884d3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.164936 May 26 18:14:05.171931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 471/986] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:05 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:14:06.189896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:06.190544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:06.197796 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:06.198296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:06.199073 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:06.199518 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:06.327682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:06.336349 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:06.337848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:06.338985 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eade9d42-66c2-470f-9e68-23ffbaf967ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.152999 May 26 18:14:06.339543 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 516/987] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:06 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:06.738615 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-f510a3c8-48d9-4590-9e72-2db4db7abd29 req-0acb2ace-1664-4b06-8e27-597d510555ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "name": "network-vif-plugged", "status": "completed", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:06.748694 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f510a3c8-48d9-4590-9e72-2db4db7abd29 req-0acb2ace-1664-4b06-8e27-597d510555ac service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:06.749157 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f510a3c8-48d9-4590-9e72-2db4db7abd29 req-0acb2ace-1664-4b06-8e27-597d510555ac service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:06.762003 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-f510a3c8-48d9-4590-9e72-2db4db7abd29 req-0acb2ace-1664-4b06-8e27-597d510555ac service nova] Creating event network-vif-plugged:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:14:06.767069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-f510a3c8-48d9-4590-9e72-2db4db7abd29 req-0acb2ace-1664-4b06-8e27-597d510555ac service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 May 26 18:14:06.767662 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 472/988] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:14:07.356989 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:07.357609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:07.360029 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:07.366471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:07.366934 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:07.367801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:07.368245 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:07.503992 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:07.513193 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:07.514735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:07.515840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-00d4ea40-20fd-4a2a-9a25-354875a4c6ea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.162856 May 26 18:14:07.516390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 517/989] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:07 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:08.541558 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:08.545814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:08.546547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:08.553208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:08.553665 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:08.554534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:08.554976 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:08.690847 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:08.699840 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:08.701351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:08.702485 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cc6ac4dd-222c-4249-8abe-b0cdd6462048 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1408 microversion: 2.20 time: 0.162307 May 26 18:14:08.703033 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 473/990] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:08 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:09.720829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:09.721439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:09.723973 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:09.724851 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:09.731403 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:09.731862 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:09.732635 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:09.733073 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:09.865281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:09.873211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:09.875111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:09.876272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad7f9507-9889-4f29-acf0-75cbbf114605 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1600 microversion: 2.20 time: 0.159397 May 26 18:14:09.876832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 518/991] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:09 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:14:09.893881 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:09.894459 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:09.901964 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:09.902450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:09.903223 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:09.903666 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:09.980642 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b184d81d-039c-43d1-9f02-2890a2c97146 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090615 May 26 18:14:09.981239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 474/992] 10.222.0.76 () {60 vars in 1315 bytes} [Thu May 26 18:14:09 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:14:10.947269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-aebab637-7f34-4261-aa99-f4e427134bfe req-53cc438f-55e8-4fa3-9c04-48b9dc105dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:10.956054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-aebab637-7f34-4261-aa99-f4e427134bfe req-53cc438f-55e8-4fa3-9c04-48b9dc105dc1 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:10.956588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-aebab637-7f34-4261-aa99-f4e427134bfe req-53cc438f-55e8-4fa3-9c04-48b9dc105dc1 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:10.969763 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-aebab637-7f34-4261-aa99-f4e427134bfe req-53cc438f-55e8-4fa3-9c04-48b9dc105dc1 service nova] Creating event network-changed:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:14:10.975765 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-aebab637-7f34-4261-aa99-f4e427134bfe req-53cc438f-55e8-4fa3-9c04-48b9dc105dc1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 May 26 18:14:10.976378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 519/993] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:25.302072 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:25.302889 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=35 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:25.306821 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:25.307313 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:25.314762 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:25.315208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:25.315967 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:25.317016 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:25.399548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lazy-loading 'services' on Instance uuid d777e891-39fc-40a2-9e37-11ea2f519575 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:14:25.471682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f0dc5dc-0109-45bf-8341-99eb2ad4f4bc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575/os-volume_attachments/c2c2b82c-dcd6-421b-8472-04f43479ce72" status: 202 len: 0 microversion: 2.1 time: 0.171452 May 26 18:14:25.472270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 475/994] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:14:25 2022] DELETE /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575/os-volume_attachments/c2c2b82c-dcd6-421b-8472-04f43479ce72 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:14:26.593590 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:26.594362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:26.598896 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:26.599482 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:26.607062 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:26.607453 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:26.608196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:26.608666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:26.635546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:14:26.712370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1054b861-59bb-4e47-a160-d000efecd8d5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 204 len: 0 microversion: 2.1 time: 0.120013 May 26 18:14:26.713284 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 520/995] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:14:26 2022] DELETE /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:14:26.721883 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:26.722891 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:26.730282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:26.730744 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:26.731664 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:26.732116 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:26.866214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:26.873772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e2a9e883-519f-4dac-a684-080a417743b4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1514 microversion: 2.1 time: 0.156442 May 26 18:14:26.874377 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 476/996] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:26 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:27.892308 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:27.893713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:27.901492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:27.901939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:27.902741 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:27.903181 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:28.034517 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:28.042486 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bc0b35f-ca98-44a4-adfb-0327c22d22f3 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1514 microversion: 2.1 time: 0.154426 May 26 18:14:28.043071 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 521/997] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:27 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:29.059844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:29.060487 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:29.067295 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:29.067753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:29.068559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:29.068999 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:29.272533 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:29.280700 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0e134b28-6024-4ad5-9bea-7587cdf655bb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 200 len: 1514 microversion: 2.1 time: 0.224729 May 26 18:14:29.281465 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 477/998] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:29 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:29.448454 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7448aaa4-35cc-4faf-8b62-7f157f8c057b req-aa9c3f59-c5cb-43b4-b283-8d6dbc5a5fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d777e891-39fc-40a2-9e37-11ea2f519575", "name": "network-vif-deleted", "tag": "5f54c3b5-d7b5-4be9-9468-da72b838cb66"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:29.460474 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7448aaa4-35cc-4faf-8b62-7f157f8c057b req-aa9c3f59-c5cb-43b4-b283-8d6dbc5a5fbb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:29.460854 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7448aaa4-35cc-4faf-8b62-7f157f8c057b req-aa9c3f59-c5cb-43b4-b283-8d6dbc5a5fbb service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:29.473113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7448aaa4-35cc-4faf-8b62-7f157f8c057b req-aa9c3f59-c5cb-43b4-b283-8d6dbc5a5fbb service nova] Creating event network-vif-deleted:5f54c3b5-d7b5-4be9-9468-da72b838cb66 for instance d777e891-39fc-40a2-9e37-11ea2f519575 on hv-cinder-83906 May 26 18:14:29.479204 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7448aaa4-35cc-4faf-8b62-7f157f8c057b req-aa9c3f59-c5cb-43b4-b283-8d6dbc5a5fbb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034027 May 26 18:14:29.480123 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 522/999] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:30.299055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:30.299783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: d777e891-39fc-40a2-9e37-11ea2f519575] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:30.307085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:30.307539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:30.308312 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:30.308749 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:30.322782 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] HTTP exception thrown: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Request method failure captured: May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 HTTP/1.1 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8NNEO5Bbe6MAsHnBQgYFL0-jqOy-CvFIO5biBotcOkJJOEAH4k4OhJg0xeGWE6M9fnHJNlG5HM3K7mTGYxoXHQoeYmgu7DO-QiRBzOvXfyv7BGqJFiFgGdwR36UclC0RgVaB6Gz2yMxzCESt7eGGoTXo8d7KPdbppwax_VaPslz4ag May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: fd9dfeec33544d148b87d188b4208835 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:14:30.324439 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd9dfeec33544d148b87d188b4208835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fd9dfeec33544d148b87d188b4208835 May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotTestJSON-1699187648-project May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: a461e083aa424e1dbf1acc0b68b4b1df May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699187648-project May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. May 26 18:14:30.326124 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'd777e891-39fc-40a2-9e37-11ea2f519575'} May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:14:30.327138 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. May 26 18:14:30.328719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:14:30.330106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Returning 404 to user: Instance d777e891-39fc-40a2-9e37-11ea2f519575 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:14:30.330106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-751698fb-519e-4777-a513-6b88a93b8cf5 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575" status: 404 len: 111 microversion: 2.1 time: 0.030764 May 26 18:14:30.330106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 478/1000] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:30 2022] GET /compute/v2.1/servers/d777e891-39fc-40a2-9e37-11ea2f519575 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:14:40.168793 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1583549228", "imageRef": "4350a9e9-482f-42f1-85de-fa04a1b3ef6d", "flavorRef": "452", "networks": [{"uuid": "99892cad-2ee2-484d-9d46-3d47317062eb"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:40.176093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.176742 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.226104 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] validate_networks() for [('99892cad-2ee2-484d-9d46-3d47317062eb', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:14:40.831981 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:14:40.832402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:14:40.832902 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:14:40.833315 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:14:40.833784 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:14:40.842666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:40.843119 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:40.843924 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:40.844362 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:40.860749 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Getting quotas for project fd9dfeec33544d148b87d188b4208835. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:14:40.865376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Getting quotas for user a461e083aa424e1dbf1acc0b68b4b1df and project fd9dfeec33544d148b87d188b4208835. Resources: {'ram', 'instances', 'cores'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:14:40.876527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:14:40.879575 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350a9e9-482f-42f1-85de-fa04a1b3ef6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:14:40.924319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ee4a0f32-185b-4082-bec6-1956906e52db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759815 May 26 18:14:40.928672 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 523/1001] 10.222.0.76 () {60 vars in 1146 bytes} [Thu May 26 18:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:14:40.936085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02abaffd-a7bd-49c3-b025-e541bbdf74ce tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:40.936758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-02abaffd-a7bd-49c3-b025-e541bbdf74ce tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:40.939717 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.940405 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.998027 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-02abaffd-a7bd-49c3-b025-e541bbdf74ce tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:41.005623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-02abaffd-a7bd-49c3-b025-e541bbdf74ce tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1219 microversion: 2.1 time: 0.073682 May 26 18:14:41.006446 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 479/1002] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:40 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:42.024616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:42.025327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:42.033346 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:42.033848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:42.035294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:42.035724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:42.115340 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:42.123385 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d73c9fe1-ab15-4d94-becc-1399db3f77db tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1277 microversion: 2.1 time: 0.104446 May 26 18:14:42.124192 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 524/1003] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:42 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:43.140931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:43.141543 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:43.151238 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:43.151822 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:43.156427 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:43.156427 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:43.354056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d8d0a303-4e44-4272-9a1e-025612b01db4 req-52ac8119-6497-4a69-9edc-56b1314d6b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2186203-2cac-424f-827c-afa5f96dd3ce", "tag": "1ddd7828-82fd-4380-a913-e58631e94cec"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:43.364601 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d8d0a303-4e44-4272-9a1e-025612b01db4 req-52ac8119-6497-4a69-9edc-56b1314d6b96 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:43.365088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d8d0a303-4e44-4272-9a1e-025612b01db4 req-52ac8119-6497-4a69-9edc-56b1314d6b96 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:43.368726 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:43.376531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d8d0a303-4e44-4272-9a1e-025612b01db4 req-52ac8119-6497-4a69-9edc-56b1314d6b96 service nova] Creating event network-changed:1ddd7828-82fd-4380-a913-e58631e94cec for instance c2186203-2cac-424f-827c-afa5f96dd3ce on hv-cinder-83906 May 26 18:14:43.379779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0eaf082e-af68-4039-bf69-266ae2b8caa4 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.242570 May 26 18:14:43.380633 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 480/1004] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:43 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:43.390728 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d8d0a303-4e44-4272-9a1e-025612b01db4 req-52ac8119-6497-4a69-9edc-56b1314d6b96 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040139 May 26 18:14:43.391351 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 525/1005] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:14:44.396325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:44.396895 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:44.403539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:44.403987 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:44.404745 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:44.405177 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:44.535391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:44.542810 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-48718efb-61fa-4f70-b9c9-0c4a666c5643 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.150453 May 26 18:14:44.543369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 481/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:44 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:45.560701 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:45.561412 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:45.568897 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:45.569356 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:45.570122 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:45.570589 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:45.703639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:45.712263 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7e3c62d2-2301-4225-bdaa-aff5b9ffd29e tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.155848 May 26 18:14:45.712832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 526/1007] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:45 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:46.729014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:46.729658 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:46.736220 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:46.736680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:46.737478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:46.738018 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:46.986063 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:46.994351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e7cebb7e-b1ea-4ea8-ac21-0de54de51ea1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.269037 May 26 18:14:47.006556 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 482/1008] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:46 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:48.013003 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:48.013644 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:48.021417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:48.021866 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:48.022665 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:48.023110 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:48.218130 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:48.226465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ece9e354-2f24-4507-89fe-30009007e4cb tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.218007 May 26 18:14:48.227034 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 527/1009] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:48 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:48.918173 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9eb47f94-83c7-408b-b28e-1d7cb93678bf req-83c924ad-5c10-4c26-b4b7-b1b000b47e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2186203-2cac-424f-827c-afa5f96dd3ce", "name": "network-vif-plugged", "status": "completed", "tag": "1ddd7828-82fd-4380-a913-e58631e94cec"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:48.928014 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9eb47f94-83c7-408b-b28e-1d7cb93678bf req-83c924ad-5c10-4c26-b4b7-b1b000b47e5f service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:48.928470 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9eb47f94-83c7-408b-b28e-1d7cb93678bf req-83c924ad-5c10-4c26-b4b7-b1b000b47e5f service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:48.939720 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9eb47f94-83c7-408b-b28e-1d7cb93678bf req-83c924ad-5c10-4c26-b4b7-b1b000b47e5f service nova] Creating event network-vif-plugged:1ddd7828-82fd-4380-a913-e58631e94cec for instance c2186203-2cac-424f-827c-afa5f96dd3ce on hv-cinder-83906 May 26 18:14:48.945440 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9eb47f94-83c7-408b-b28e-1d7cb93678bf req-83c924ad-5c10-4c26-b4b7-b1b000b47e5f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 May 26 18:14:48.946045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 483/1010] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:14:49.243754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:49.244368 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:49.250851 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:49.251300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:49.252065 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:49.252505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:49.386929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:49.394529 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60d8af8a-eb85-4aa0-8922-97cca2ee3692 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.154702 May 26 18:14:49.395113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 528/1011] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:49 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:50.412861 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:50.413572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:50.419925 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:50.420384 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:50.421154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:50.421606 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:50.555958 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:50.563676 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-57981a07-7eab-4e53-86fd-95c33a8adc89 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1319 microversion: 2.1 time: 0.155844 May 26 18:14:50.564254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 484/1012] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:50 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:51.580825 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:51.582015 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:51.584483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.585136 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.591017 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.591475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:51.592248 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.592685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:51.721359 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:51.729030 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c1ce420-74cd-474f-a571-0f59166f5b56 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1508 microversion: 2.1 time: 0.152081 May 26 18:14:51.729596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 529/1013] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:14:51 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:51.745154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca65cc42-d674-45cc-b30f-d178363b3863", "device": "/dev/sdb"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:51.746758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:51.748775 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.754971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.755420 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:51.756185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.756621 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:52.009780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8e07e509-f8c1-430b-9f67-3858d1be75ec tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "POST /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268411 May 26 18:14:52.010463 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 485/1014] 10.222.0.76 () {60 vars in 1322 bytes} [Thu May 26 18:14:51 2022] POST /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:57.263756 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:57.264327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:57.271386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.271843 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.272615 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.273056 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.298125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a1ed462e-c63d-4d1b-90e9-3d6b25b8323c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.037744 May 26 18:14:57.298292 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 530/1015] 10.222.0.76 () {60 vars in 1288 bytes} [Thu May 26 18:14:57 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:14:59.092136 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:59.092753 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:59.098997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.099447 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.100219 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.100643 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.122483 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lazy-loading 'flavor' on Instance uuid 6b179d75-fc35-42af-8ef7-b7a38b7992e2 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:14:59.382786 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-55412dfe-89bd-4921-b81c-dd23d09904f6 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/action" status: 202 len: 0 microversion: 2.20 time: 0.295266 May 26 18:14:59.383411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 486/1016] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 26 18:14:59 2022] POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:14:59.392196 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:59.392817 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:59.400676 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.401066 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.402824 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.403264 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.538885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:59.547033 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:59.548540 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:59.550494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-654a17ef-d071-4357-b20b-7c06c81c2bea tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.162313 May 26 18:14:59.551238 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 531/1017] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:14:59 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:00.570480 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:00.571173 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:00.577477 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:00.577932 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:00.578722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:00.579153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:00.711671 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:00.719763 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:00.721816 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:00.723019 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bbd51a92-2266-47c8-b59e-9a787e0c8fd7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.157840 May 26 18:15:00.723603 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 487/1018] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:00 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:01.743215 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:01.743830 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:01.750004 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:01.750499 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:01.751389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:01.751840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:01.883900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:01.891789 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:01.893560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:01.894929 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93d302cc-e065-41dc-9358-ac5375abf0d0 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.156964 May 26 18:15:01.895480 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 532/1019] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:01 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:02.913526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:02.914150 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:02.922043 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:02.922526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:02.923307 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:02.923752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:03.061539 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:03.070096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:03.071640 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:03.072807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-36b23d17-cd33-4ac9-90ed-5ab2a4f14cb5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.163256 May 26 18:15:03.073355 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 488/1020] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:02 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:04.090925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:04.091549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:04.098818 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:04.099269 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:04.100028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:04.100463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:04.234750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:04.243519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:04.245036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:04.246233 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-06787f73-b4f1-4206-843d-b2e70daffce3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.159218 May 26 18:15:04.246795 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 533/1021] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:04 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:05.264624 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:05.265250 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:05.272468 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:05.272928 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:05.273702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:05.274148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:05.404259 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:05.412261 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:05.413780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:05.414981 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a3e71b45-5550-4ead-8dcc-bdc3091f71bd tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.154332 May 26 18:15:05.425791 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 489/1022] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:05 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:06.443442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:06.444060 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:06.450595 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:06.451038 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:06.451801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:06.452242 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:06.584416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:06.592271 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:06.593768 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:06.594959 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-866f8131-4b1d-4a08-b337-b2badbf3b5bb tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.155671 May 26 18:15:06.595520 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 534/1023] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:06 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:07.614729 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:07.615351 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:07.621998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:07.622477 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:07.623244 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:07.623680 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:07.762899 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:07.771278 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:07.772792 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:07.773998 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8c3e00e3-f56c-4a1d-ab60-94009c4989a4 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.164158 May 26 18:15:07.774610 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 490/1024] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:07 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:08.793734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:08.794363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:08.801281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:08.801739 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:08.802559 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:08.803013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:08.931151 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:08.939426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:08.942675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:08.943848 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f81f7431-5dd5-4f49-afae-237e5cc6fe8f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.154041 May 26 18:15:08.944405 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 535/1025] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:08 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:09.963399 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:09.963987 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:09.971785 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:09.972251 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:09.973031 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:09.973475 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:10.104257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:10.112407 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:10.113929 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:10.115119 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cfe27fdf-4bc5-4a79-be92-5257a21a0e5d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.156688 May 26 18:15:10.115752 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 491/1026] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:09 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:11.132750 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:11.133285 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:11.135609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:11.141036 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:11.141492 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:11.142327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:11.142810 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:11.146379 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=69 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:11.277085 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:11.286055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:11.287578 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:11.288762 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa3eef45-867d-4c34-8551-07a78fa792ab tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.160018 May 26 18:15:11.289328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 536/1027] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:11 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:11.543497 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:11.543978 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:11.546424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=29 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:11.552343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:11.552800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:11.553572 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:11.554011 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:11.556573 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:11.638344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lazy-loading 'services' on Instance uuid c2186203-2cac-424f-827c-afa5f96dd3ce {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:15:11.713450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8aeeba24-1bdb-4a5b-8e2f-cfa5f437945b tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce/os-volume_attachments/ca65cc42-d674-45cc-b30f-d178363b3863" status: 202 len: 0 microversion: 2.1 time: 0.173673 May 26 18:15:11.714046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 492/1028] 10.222.0.76 () {58 vars in 1415 bytes} [Thu May 26 18:15:11 2022] DELETE /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce/os-volume_attachments/ca65cc42-d674-45cc-b30f-d178363b3863 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:15:12.307105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:12.307724 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:12.314430 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.315558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:12.316333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.316777 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:12.450091 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:12.458131 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:12.459735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:12.460937 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b0c283f1-3daf-42d8-aff5-04d2d3b8fecc tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.157693 May 26 18:15:12.461501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 537/1029] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:12 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:12.834456 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:12.835046 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:12.841780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.842269 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:12.843044 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.843485 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:12.869194 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:15:12.943682 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bb0e6574-3853-4355-9d07-03a527153169 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 204 len: 0 microversion: 2.1 time: 0.113750 May 26 18:15:12.944350 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 493/1030] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:15:12 2022] DELETE /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:15:12.953541 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:12.954158 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:12.960747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.961211 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:12.961969 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:12.962465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:13.094554 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:13.102801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c9c2f9a1-1490-42ab-a928-5a2e168fd2f1 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1514 microversion: 2.1 time: 0.153147 May 26 18:15:13.103375 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 538/1031] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:12 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:13.480541 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:13.481661 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:13.488094 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:13.488551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:13.489325 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:13.489768 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:13.637735 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:13.645798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:13.647362 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:13.648548 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bd615a57-47db-4b74-9eff-114027675278 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.172624 May 26 18:15:13.649114 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 494/1032] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:13 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:14.119733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:14.120400 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:14.127029 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:14.127610 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:14.128572 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:14.129024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:14.259012 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:14.266449 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ccb2c377-9ad2-42f3-a1b8-e06ba1ac4afc tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1514 microversion: 2.1 time: 0.150684 May 26 18:15:14.267008 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 539/1033] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:14 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:14.669333 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:14.669952 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:14.677324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:14.677824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:14.678670 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:14.679119 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:14.809923 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:14.818522 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:14.820043 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:14.821207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1d5403fc-7280-48db-94b5-53236092404f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.157134 May 26 18:15:14.821934 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 495/1034] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:14 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:15.285313 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:15.286039 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:15.293387 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:15.293935 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:15.294740 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:15.295255 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:15.438227 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461e083aa424e1dbf1acc0b68b4b1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9dfeec33544d148b87d188b4208835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:15.446819 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a92413a2-a9f7-4b22-95fb-81a28f936121 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 200 len: 1514 microversion: 2.1 time: 0.165758 May 26 18:15:15.447421 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 540/1035] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:15 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:15.544865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-06b24fb7-312f-45f1-93b5-8b57f1592105 req-8e272521-4cea-46ae-9099-b7283d56aee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2186203-2cac-424f-827c-afa5f96dd3ce", "name": "network-vif-deleted", "tag": "1ddd7828-82fd-4380-a913-e58631e94cec"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:15.553702 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-06b24fb7-312f-45f1-93b5-8b57f1592105 req-8e272521-4cea-46ae-9099-b7283d56aee4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:15.554144 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-06b24fb7-312f-45f1-93b5-8b57f1592105 req-8e272521-4cea-46ae-9099-b7283d56aee4 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:15.565324 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-06b24fb7-312f-45f1-93b5-8b57f1592105 req-8e272521-4cea-46ae-9099-b7283d56aee4 service nova] Creating event network-vif-deleted:1ddd7828-82fd-4380-a913-e58631e94cec for instance c2186203-2cac-424f-827c-afa5f96dd3ce on hv-cinder-83906 May 26 18:15:15.570526 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-06b24fb7-312f-45f1-93b5-8b57f1592105 req-8e272521-4cea-46ae-9099-b7283d56aee4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092422 May 26 18:15:15.571148 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 496/1036] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:15.840078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:15.845028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:15.848799 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:15.849279 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:15.850048 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:15.851558 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:15.992993 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:16.001113 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:16.003096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:16.004285 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-51ffb345-354e-4772-9a77-80ab0abea3d8 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1745 microversion: 2.20 time: 0.168260 May 26 18:15:16.004849 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 541/1037] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:15 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:15:16.465623 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:16.466393 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] [instance: c2186203-2cac-424f-827c-afa5f96dd3ce] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:16.472748 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:16.473199 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:16.473963 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:16.474433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:16.487827 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] HTTP exception thrown: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Request method failure captured: May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce HTTP/1.1 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8NNEO5Bbe6MAsHnBQgYFL0-jqOy-CvFIO5biBotcOkJJOEAH4k4OhJg0xeGWE6M9fnHJNlG5HM3K7mTGYxoXHQoeYmgu7DO-QiRBzOvXfyv7BGqJFiFgGdwR36UclC0RgVaB6Gz2yMxzCESt7eGGoTXo8d7KPdbppwax_VaPslz4ag May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: fd9dfeec33544d148b87d188b4208835 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:15:16.489438 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd9dfeec33544d148b87d188b4208835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd9dfeec33544d148b87d188b4208835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fd9dfeec33544d148b87d188b4208835 May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699187648 May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotTestJSON-1699187648-project May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: a461e083aa424e1dbf1acc0b68b4b1df May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699187648-project May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. May 26 18:15:16.491374 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': 'c2186203-2cac-424f-827c-afa5f96dd3ce'} May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:15:16.492361 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. May 26 18:15:16.494249 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:16.495652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] Returning 404 to user: Instance c2186203-2cac-424f-827c-afa5f96dd3ce could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:15:16.495652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8d021df4-890d-4b0c-8994-85851c6f8799 tempest-VolumesSnapshotTestJSON-1699187648 tempest-VolumesSnapshotTestJSON-1699187648-project] 10.222.0.76 "GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce" status: 404 len: 111 microversion: 2.1 time: 0.030241 May 26 18:15:16.495652 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 497/1038] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:16 2022] GET /compute/v2.1/servers/c2186203-2cac-424f-827c-afa5f96dd3ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:15:17.023114 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:17.023734 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:17.030648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:17.031105 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:17.031885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:17.032329 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:17.165121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:17.173095 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:17.175444 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:17.176623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-85cad6db-0717-4069-b613-592e17477406 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1745 microversion: 2.20 time: 0.157471 May 26 18:15:17.177185 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 542/1039] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:17 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:18.197778 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:18.199070 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:18.207931 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:18.208398 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:18.209190 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:18.209687 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:18.372481 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:18.382254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:18.383775 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:18.385119 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a59767e-fd5c-4107-a7df-211e1fe9fead tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.194204 May 26 18:15:18.385679 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 498/1040] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:18 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:19.405609 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:19.409604 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:19.417314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:19.418378 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:19.419680 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:19.420434 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:19.601534 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:19.611573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:19.613623 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:19.619373 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07c04a7a-2c12-4334-9b4d-a1b2d635ac27 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.218014 May 26 18:15:19.620327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 543/1041] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:19 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:20.206441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-e08f9349-c7e4-4ff0-b7a6-98f6d9df623f req-f10c2059-0cf6-42ec-b054-b6f71b9c5ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "name": "network-vif-plugged", "status": "completed", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:20.218319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e08f9349-c7e4-4ff0-b7a6-98f6d9df623f req-f10c2059-0cf6-42ec-b054-b6f71b9c5ec5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.219762 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e08f9349-c7e4-4ff0-b7a6-98f6d9df623f req-f10c2059-0cf6-42ec-b054-b6f71b9c5ec5 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.243926 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-e08f9349-c7e4-4ff0-b7a6-98f6d9df623f req-f10c2059-0cf6-42ec-b054-b6f71b9c5ec5 service nova] Creating event network-vif-plugged:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:15:20.252873 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-e08f9349-c7e4-4ff0-b7a6-98f6d9df623f req-f10c2059-0cf6-42ec-b054-b6f71b9c5ec5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050696 May 26 18:15:20.254340 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 499/1042] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:20.638565 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:20.639218 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:20.645616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.647979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.648978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.649732 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.696206 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:20.696807 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:20.706467 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.706926 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.707719 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.708328 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.748835 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:15:20.834987 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:20.850424 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:20.852519 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:20.854141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-414c1ebe-44b4-4e4b-80fb-afb28e4a42d5 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.219676 May 26 18:15:20.870713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 544/1043] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:20 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:20.878851 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-bcfca270-3493-431e-8a7f-76059aa0d7c0 req-b6164bf4-d058-4556-b8ae-7ccc8d5e273c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85ca5fa-25c1-48a0-abb3-6e2198a1cda1", "tag": "f80146df-c3ab-4dc2-926f-34412d539bbd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:20.892295 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bcfca270-3493-431e-8a7f-76059aa0d7c0 req-b6164bf4-d058-4556-b8ae-7ccc8d5e273c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.895141 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bcfca270-3493-431e-8a7f-76059aa0d7c0 req-b6164bf4-d058-4556-b8ae-7ccc8d5e273c service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.896480 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0d4e1d96-de99-46a2-a035-c7eeadae7383 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 204 len: 0 microversion: 2.1 time: 0.204334 May 26 18:15:20.897594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 500/1044] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:15:20 2022] DELETE /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:15:20.912713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:20.912713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:20.920402 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-bcfca270-3493-431e-8a7f-76059aa0d7c0 req-b6164bf4-d058-4556-b8ae-7ccc8d5e273c service nova] Creating event network-changed:f80146df-c3ab-4dc2-926f-34412d539bbd for instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 on hv-cinder-83906 May 26 18:15:20.925905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.925905 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.926779 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:20.928851 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:20.930401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-bcfca270-3493-431e-8a7f-76059aa0d7c0 req-b6164bf4-d058-4556-b8ae-7ccc8d5e273c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057452 May 26 18:15:20.937713 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 545/1045] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:21.099828 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:21.108736 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5708ebc1-8535-42ef-886c-a278d64ad74c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1577 microversion: 2.1 time: 0.204411 May 26 18:15:21.109808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 501/1046] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:20 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:21.885832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:21.886566 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:21.901124 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:21.901594 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:21.902955 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:21.903797 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:22.081543 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:22.090717 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:22.092625 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:22.095190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b7c49bd-2b9e-49b7-8656-d4980dcb7c46 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.213813 May 26 18:15:22.096984 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 546/1047] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:21 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:22.125912 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:22.126568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:22.135594 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:22.136175 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:22.136844 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:22.139818 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:22.313839 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:22.323214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-073ba1f7-524a-4b99-86a1-0cc804779cea tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1577 microversion: 2.1 time: 0.201318 May 26 18:15:22.332819 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 502/1048] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:22 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:23.114801 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:23.115760 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:23.137754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:23.138156 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:23.138978 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:23.140181 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:23.340128 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:23.341501 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:23.347777 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:23.358090 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:23.358430 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:23.360111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:23.361152 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:23.361880 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f433b910-656e-4071-9444-35ec96700121 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.251181 May 26 18:15:23.374226 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:23.374456 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 547/1049] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:23 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:23.374581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:23.643432 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:23.653021 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47c9de03-b655-477a-a336-48eee8f2baf5 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1577 microversion: 2.1 time: 0.317314 May 26 18:15:23.665396 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 503/1050] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:23 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1577 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:23.789899 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-810f8038-6947-4d7f-a18b-16af0b2b58a1 req-ef70c93c-9456-4d00-a446-3267a864c4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85ca5fa-25c1-48a0-abb3-6e2198a1cda1", "name": "network-vif-deleted", "tag": "f80146df-c3ab-4dc2-926f-34412d539bbd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:23.799025 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-810f8038-6947-4d7f-a18b-16af0b2b58a1 req-ef70c93c-9456-4d00-a446-3267a864c4e7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:23.799632 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-810f8038-6947-4d7f-a18b-16af0b2b58a1 req-ef70c93c-9456-4d00-a446-3267a864c4e7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:23.811843 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-810f8038-6947-4d7f-a18b-16af0b2b58a1 req-ef70c93c-9456-4d00-a446-3267a864c4e7 service nova] Creating event network-vif-deleted:f80146df-c3ab-4dc2-926f-34412d539bbd for instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 on hv-cinder-83906 May 26 18:15:23.817380 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-810f8038-6947-4d7f-a18b-16af0b2b58a1 req-ef70c93c-9456-4d00-a446-3267a864c4e7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 May 26 18:15:23.822748 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 548/1051] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:24.383122 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:24.384507 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:24.391840 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:24.392687 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:24.393970 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:24.394625 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:24.560461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:24.569157 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:24.571112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:24.572408 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-49682d06-2058-4e5d-aa67-c27ea45af733 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.193144 May 26 18:15:24.573429 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 504/1052] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:24 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:24.677572 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:24.679576 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:24.688224 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:24.689653 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:24.690586 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:24.691040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:24.732481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:24.733209 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:24.733879 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lazy-loading 'fault' on Instance uuid f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:15:24.787348 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:24.795501 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9a2f8b23-e42d-490e-9578-545f619a3f4c tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 200 len: 1228 microversion: 2.1 time: 0.126106 May 26 18:15:24.796390 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 549/1053] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:24 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 1228 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:25.591715 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:25.592951 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:25.601746 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:25.602215 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:25.603010 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:25.603450 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:25.771205 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:25.780783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:25.782282 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:25.784144 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6080e6c8-e1de-4213-a8bb-6a5e78e34471 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.196558 May 26 18:15:25.784820 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 505/1054] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:25 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:25.813125 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:25.813747 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: f85ca5fa-25c1-48a0-abb3-6e2198a1cda1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:25.820939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:25.821865 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:25.822873 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:25.823511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:25.839506 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] HTTP exception thrown: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Request method failure captured: May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 HTTP/1.1 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8G82G1uHFHlMcc6TEzCtjvKciJb6NmnP1QDgi-Lbc5IcwGM7cJGG7-N6tIC8oyJJf-1-tF0oQYfs8UGm6f6CupkigQKNper5reqviBZs40y15Nrysrn4tm_pUxgDtqiSdtT4EuDD3WwWuJr70Zp_LSA6VHDpCcImZan9h33Ha90Jb0 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:15:25.841419 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_45d94db7075c40cbae3f106a9661d969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-775328860 May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 42c96a85400941818b658cca8cb56fec May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. May 26 18:15:25.843159 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': 'f85ca5fa-25c1-48a0-abb3-6e2198a1cda1'} May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:15:25.844096 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. May 26 18:15:25.846800 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:25.849283 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Returning 404 to user: Instance f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:15:25.850236 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ffc11d6e-9ece-4af2-adf2-12eba2c7bedf tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1" status: 404 len: 111 microversion: 2.1 time: 0.041217 May 26 18:15:25.851020 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 550/1055] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:25 2022] GET /compute/v2.1/servers/f85ca5fa-25c1-48a0-abb3-6e2198a1cda1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:15:26.808664 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:26.809703 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:26.817502 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:26.819860 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:26.823229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:26.823864 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:26.988041 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:26.997272 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:27.015980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:27.018149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:27.022701 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-37359bdc-9289-4e91-b2f2-a9eba6205159 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.220811 May 26 18:15:27.023865 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 506/1056] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:26 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:28.043366 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:28.043979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:28.050776 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:28.051230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:28.052031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:28.052440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:28.196685 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:28.204857 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:28.207040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:28.208216 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bea0bf62-3cad-4dac-9066-c430e85e5206 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.168739 May 26 18:15:28.208767 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 551/1057] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:28 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:29.226722 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:29.227344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:29.235153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:29.235620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:29.236393 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:29.236828 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:29.368672 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:29.377153 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:29.378783 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:29.379936 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-78e3c691-ad19-417e-9b18-25c26364fc5a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1740 microversion: 2.20 time: 0.157149 May 26 18:15:29.380488 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 507/1058] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:29 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:30.398416 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:30.398974 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:30.405709 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:30.406171 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:30.407024 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:30.407494 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:30.550401 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:30.558932 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:30.560418 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:30.561583 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4bc7ea85-120a-44e2-b841-00055cce208a tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1722 microversion: 2.20 time: 0.167361 May 26 18:15:30.562142 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 552/1059] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:30 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:31.581885 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:31.582540 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:31.589177 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:31.589628 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:31.590422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:31.590872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:31.732982 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:31.741392 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:31.743038 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:31.744214 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8448c29-80d7-438f-ae30-e9a0faaf9076 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1722 microversion: 2.20 time: 0.167394 May 26 18:15:31.744772 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 508/1060] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:31 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:32.113912 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:32.114505 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:32.119021 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-349ac743-1984-4ad3-a4f0-008db7de68ae req-acaa4f95-5d83-4e63-b87f-e472726cebe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d037f7b-7d2e-440e-9e58-917176fdd5f4", "tag": "0050fac2-27f6-43c1-9c41-168fb25746b5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:32.123921 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.124384 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.125163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.125608 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.133007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-349ac743-1984-4ad3-a4f0-008db7de68ae req-acaa4f95-5d83-4e63-b87f-e472726cebe8 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.133007 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-349ac743-1984-4ad3-a4f0-008db7de68ae req-acaa4f95-5d83-4e63-b87f-e472726cebe8 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.146215 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-349ac743-1984-4ad3-a4f0-008db7de68ae req-acaa4f95-5d83-4e63-b87f-e472726cebe8 service nova] Creating event network-changed:0050fac2-27f6-43c1-9c41-168fb25746b5 for instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 on hv-cinder-83906 May 26 18:15:32.152469 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-349ac743-1984-4ad3-a4f0-008db7de68ae req-acaa4f95-5d83-4e63-b87f-e472726cebe8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038128 May 26 18:15:32.153165 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 509/1061] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:15:32.171203 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:15:32.198573 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:32.268953 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4457194a-0b03-4bba-a921-67d87f06613f tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 204 len: 0 microversion: 2.1 time: 0.159323 May 26 18:15:32.269560 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 553/1062] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:15:32 2022] DELETE /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:15:32.278626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:32.279253 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:32.286801 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.287550 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.288265 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.288699 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.429800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:32.437886 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77da507a-c7a5-4eb8-b8db-2e56077965c9 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1576 microversion: 2.1 time: 0.163784 May 26 18:15:32.438728 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 510/1063] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:32 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:32.763443 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:32.764190 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:32.771805 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.772255 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.773040 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.773540 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.924872 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:32.933812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:32.935369 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:32.936580 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-38e18477-51f7-469c-b505-b22dfaa22079 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1722 microversion: 2.20 time: 0.177439 May 26 18:15:32.937155 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 554/1064] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:32 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:33.353302 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-941f4b93-3322-4c59-901e-2dd7118bd995 req-e3ce6ce7-848c-4650-9a06-de5e377d811d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "name": "network-vif-unplugged", "status": "completed", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:33.362461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-941f4b93-3322-4c59-901e-2dd7118bd995 req-e3ce6ce7-848c-4650-9a06-de5e377d811d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.362920 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-941f4b93-3322-4c59-901e-2dd7118bd995 req-e3ce6ce7-848c-4650-9a06-de5e377d811d service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:33.374799 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-941f4b93-3322-4c59-901e-2dd7118bd995 req-e3ce6ce7-848c-4650-9a06-de5e377d811d service nova] Creating event network-vif-unplugged:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:15:33.382318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-941f4b93-3322-4c59-901e-2dd7118bd995 req-e3ce6ce7-848c-4650-9a06-de5e377d811d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105925 May 26 18:15:33.383207 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 511/1065] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:33.456052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:33.456686 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:33.463319 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.463782 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:33.464555 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.464996 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:33.606208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:33.614062 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8986daf7-b403-483c-94f5-c6f02dfa0efd tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1576 microversion: 2.1 time: 0.162621 May 26 18:15:33.614666 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 555/1066] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:33 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:33.956185 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:33.956808 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:33.963111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.963588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:33.964363 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.964790 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.132084 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:34.140303 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:34.141824 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:34.143040 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ef36a175-6f39-4273-93eb-f1479a0c1758 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1725 microversion: 2.20 time: 0.191944 May 26 18:15:34.143605 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 512/1067] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:33 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:34.162284 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71ddecc-af87-43bd-9e6f-5b7296c9350a"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:34.163613 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:34.169943 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.170465 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.171230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.171682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.463869 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-daa4a777-8c96-4e68-824b-4ec891a5a891 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306768 May 26 18:15:34.464854 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 556/1068] 10.222.0.76 () {62 vars in 1363 bytes} [Thu May 26 18:15:34 2022] POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:15:34.602147 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:34.602734 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:34.609460 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.609921 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.610795 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.611410 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.631812 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:34.632627 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:34.640088 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.640636 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.641491 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:34.642737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.801881 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:34.810406 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afa5da68-9aa4-48f3-8b35-f4203586525b tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1576 microversion: 2.1 time: 0.182318 May 26 18:15:34.811304 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 557/1069] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:34 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:34.937047 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-17536e39-6fe5-4c31-a163-51f52a05ef7d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments/d71ddecc-af87-43bd-9e6f-5b7296c9350a" status: 202 len: 0 microversion: 2.20 time: 0.338824 May 26 18:15:34.937653 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 513/1070] 10.222.0.76 () {60 vars in 1456 bytes} [Thu May 26 18:15:34 2022] DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments/d71ddecc-af87-43bd-9e6f-5b7296c9350a => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:15:35.000383 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:35.000967 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:35.008272 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.008735 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.009527 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.010031 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.093780 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-324df89a-fad5-4fb0-b58f-296a195d3735 req-efa25efe-013e-4ec1-9f08-0968509967f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d037f7b-7d2e-440e-9e58-917176fdd5f4", "name": "network-vif-deleted", "tag": "0050fac2-27f6-43c1-9c41-168fb25746b5"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:35.104707 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-324df89a-fad5-4fb0-b58f-296a195d3735 req-efa25efe-013e-4ec1-9f08-0968509967f7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.105149 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-324df89a-fad5-4fb0-b58f-296a195d3735 req-efa25efe-013e-4ec1-9f08-0968509967f7 service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.108814 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-009ad3cd-bb82-43ed-ac36-563d84a58200 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/action" status: 202 len: 0 microversion: 2.20 time: 0.112166 May 26 18:15:35.109603 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 558/1071] 10.222.0.76 () {62 vars in 1318 bytes} [Thu May 26 18:15:34 2022] POST /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:15:35.117772 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:35.118445 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:35.118575 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-324df89a-fad5-4fb0-b58f-296a195d3735 req-efa25efe-013e-4ec1-9f08-0968509967f7 service nova] Creating event network-vif-deleted:0050fac2-27f6-43c1-9c41-168fb25746b5 for instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 on hv-cinder-83906 May 26 18:15:35.124568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-324df89a-fad5-4fb0-b58f-296a195d3735 req-efa25efe-013e-4ec1-9f08-0968509967f7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 May 26 18:15:35.125233 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 514/1072] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:15:35.128757 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.129598 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.130493 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.130939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.275303 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:35.284714 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:35.286287 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:35.287450 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aa08db79-cca6-4c56-82e9-147f68d6f745 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1673 microversion: 2.20 time: 0.173774 May 26 18:15:35.298075 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 559/1073] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:35 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:15:35.827415 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:35.828130 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:35.836499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.837066 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.838173 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.839032 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.873965 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.874528 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.875065 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lazy-loading 'fault' on Instance uuid 5d037f7b-7d2e-440e-9e58-917176fdd5f4 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:15:35.929139 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c96a85400941818b658cca8cb56fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d94db7075c40cbae3f106a9661d969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:35.938411 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1039cad4-2f3b-4f1d-bed0-315bacd3fb7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 200 len: 1229 microversion: 2.1 time: 0.114762 May 26 18:15:35.939713 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 515/1074] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:35 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:36.305427 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:36.306046 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:36.312687 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.313146 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.314655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.315111 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.445979 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:36.454165 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:36.456483 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:36.457648 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-42caeff2-ec07-46af-937b-f39853e1708b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.156187 May 26 18:15:36.458218 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 560/1075] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:36 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:36.957557 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:36.958115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 5d037f7b-7d2e-440e-9e58-917176fdd5f4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:36.966208 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.967098 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.968395 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.968971 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.986383 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] HTTP exception thrown: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Request method failure captured: May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 HTTP/1.1 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8G82G1uHFHlMcc6TEzCtjvKciJb6NmnP1QDgi-Lbc5IcwGM7cJGG7-N6tIC8oyJJf-1-tF0oQYfs8UGm6f6CupkigQKNper5reqviBZs40y15Nrysrn4tm_pUxgDtqiSdtT4EuDD3WwWuJr70Zp_LSA6VHDpCcImZan9h33Ha90Jb0 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:15:36.988346 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_45d94db7075c40cbae3f106a9661d969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestVolumeBootPattern-775328860 May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 42c96a85400941818b658cca8cb56fec May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. May 26 18:15:36.990026 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '5d037f7b-7d2e-440e-9e58-917176fdd5f4'} May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:15:36.990937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. May 26 18:15:36.992401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:15:36.993766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Returning 404 to user: Instance 5d037f7b-7d2e-440e-9e58-917176fdd5f4 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:15:36.993766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-09a404c1-2938-49ef-950e-b10c953031cc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4" status: 404 len: 111 microversion: 2.1 time: 0.036905 May 26 18:15:36.993766 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 516/1076] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:36 2022] GET /compute/v2.1/servers/5d037f7b-7d2e-440e-9e58-917176fdd5f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:15:37.475158 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.476451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:37.476651 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.477091 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:37.484758 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.486058 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.487581 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.488559 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.508745 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.509515 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.510370 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.511000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.548078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] HTTP exception thrown: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Request method failure captured: May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af HTTP/1.1 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8G82G1uHFHlMcc6TEzCtjvKciJb6NmnP1QDgi-Lbc5IcwGM7cJGG7-N6tIC8oyJJf-1-tF0oQYfs8UGm6f6CupkigQKNper5reqviBZs40y15Nrysrn4tm_pUxgDtqiSdtT4EuDD3WwWuJr70Zp_LSA6VHDpCcImZan9h33Ha90Jb0 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:15:37.555241 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_45d94db7075c40cbae3f106a9661d969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 42c96a85400941818b658cca8cb56fec May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.556986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '68f6bb73-a942-4dbe-9a48-e5260f4955af'} May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:15:37.557933 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.559475 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.562374 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Returning 404 to user: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:15:37.565474 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-152dcb1f-a473-45da-aaf9-867270f53c7e tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "DELETE /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 404 len: 111 microversion: 2.1 time: 0.095577 May 26 18:15:37.569900 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 561/1077] 10.222.0.76 () {58 vars in 1238 bytes} [Thu May 26 18:15:37 2022] DELETE /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:15:37.578546 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.581261 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] [instance: 68f6bb73-a942-4dbe-9a48-e5260f4955af] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:37.597077 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.597881 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.598939 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.601093 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.635221 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] HTTP exception thrown: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Request method failure captured: May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af HTTP/1.1 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8G82G1uHFHlMcc6TEzCtjvKciJb6NmnP1QDgi-Lbc5IcwGM7cJGG7-N6tIC8oyJJf-1-tF0oQYfs8UGm6f6CupkigQKNper5reqviBZs40y15Nrysrn4tm_pUxgDtqiSdtT4EuDD3WwWuJr70Zp_LSA6VHDpCcImZan9h33Ha90Jb0 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:15:37.636847 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/45d94db7075c40cbae3f106a9661d969"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_45d94db7075c40cbae3f106a9661d969"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 45d94db7075c40cbae3f106a9661d969 May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-775328860 May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 42c96a85400941818b658cca8cb56fec May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-775328860-project May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.638530 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '68f6bb73-a942-4dbe-9a48-e5260f4955af'} May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:15:37.639442 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. May 26 18:15:37.640938 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:15:37.644596 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Returning 404 to user: Instance 68f6bb73-a942-4dbe-9a48-e5260f4955af could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:15:37.646094 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b17c5222-aa90-49dc-a771-27e8a2bd2563 tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af" status: 404 len: 111 microversion: 2.1 time: 0.071751 May 26 18:15:37.654768 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 562/1078] 10.222.0.76 () {58 vars in 1235 bytes} [Thu May 26 18:15:37 2022] GET /compute/v2.1/servers/68f6bb73-a942-4dbe-9a48-e5260f4955af => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:15:37.708944 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:37.721340 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:37.723424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:37.725115 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a8240217-1577-4cd2-8592-12e80c0c8c71 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.252447 May 26 18:15:37.726284 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 517/1079] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:37 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:38.748456 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:38.749179 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:38.756584 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.757047 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:38.757833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.758314 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:38.929439 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:38.940129 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:38.942069 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:38.943497 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f421c89-7ec6-4090-84ca-554e91e01c06 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.199013 May 26 18:15:38.944264 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 563/1080] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:38 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:39.058258 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1c2bfb17-263f-4a3f-a953-7506d06e66fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] Calling method '.version_select at 0x7f1fa04975e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:39.091412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1c2bfb17-263f-4a3f-a953-7506d06e66fc tempest-TestVolumeBootPattern-775328860 tempest-TestVolumeBootPattern-775328860-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-17761177" status: 202 len: 0 microversion: 2.1 time: 0.036705 May 26 18:15:39.094620 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 518/1081] 10.222.0.76 () {58 vars in 1256 bytes} [Thu May 26 18:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-17761177 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:15:39.961557 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:39.962471 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:39.973946 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:39.974706 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:39.975693 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:39.976549 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:40.137674 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:40.150236 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:40.152336 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:40.154005 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-44bcdcf4-3072-4ec9-a403-a2a1a219ea67 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.196378 May 26 18:15:40.155163 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 564/1082] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:39 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:15:41.174169 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:41.175640 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:41.188229 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:41.190030 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:41.191097 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:41.196505 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:41.515602 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:41.550360 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:41.556958 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:41.565343 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-215a2f9f-2feb-42d2-829b-cd5bdd069093 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.395848 May 26 18:15:41.578796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 519/1083] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:41 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:42.596109 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:42.596780 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:42.605910 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:42.611803 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:42.612832 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:42.623705 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:42.627121 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:43.397055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:43.407630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:43.409169 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:43.410404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3fb8ce8f-18fa-4190-8136-876ae3e1b37b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.819002 May 26 18:15:43.410982 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 565/1084] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:42 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:44.428500 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:44.429159 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:44.432045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:44.449257 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:44.450024 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:44.451056 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:44.451727 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:44.730672 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:44.740925 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:44.742492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:44.744055 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2ddb3742-1dd6-4dce-850c-34bf03e5658b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.319476 May 26 18:15:44.744817 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 520/1085] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:44 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:45.763417 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:45.764719 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:45.772733 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:45.773200 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:45.773994 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:45.774711 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:45.935737 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:45.947263 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:45.949013 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:45.950350 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f23414a-f58b-48ce-be2c-960104e9be9f tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.190997 May 26 18:15:45.951634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 566/1086] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:45 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:46.972492 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:46.973111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:46.979980 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:46.980433 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:46.981424 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:46.981853 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:47.225588 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:47.234085 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:47.235670 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:47.236858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-979c0771-2aa5-426c-af2e-8d4500065429 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.271690 May 26 18:15:47.237421 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 521/1087] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:46 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:48.255257 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:48.255877 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:48.262531 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:48.262986 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:48.263763 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:48.264198 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:48.267357 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:48.419538 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:48.428426 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:48.430001 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:48.431815 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b766b6f2-6aac-4670-a311-de4a97d79ae3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.181529 May 26 18:15:48.432376 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 567/1088] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:48 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:49.450751 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:49.451318 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:49.458855 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:49.459317 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:49.460111 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:49.460551 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:49.596236 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:49.604134 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:49.605626 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:49.606804 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-54a8bba9-42de-4530-8ad1-0c5af79934a1 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.160274 May 26 18:15:49.607371 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 522/1089] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:49 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:50.624885 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:50.625407 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:50.632605 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:50.633059 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:50.633809 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:50.634266 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:50.770333 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:50.780639 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:50.780891 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:50.782675 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afa73e0c-bfe2-46af-95bc-342848261940 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.161164 May 26 18:15:50.783539 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 568/1090] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:50 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:52.057478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:52.059009 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:52.065369 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:52.065830 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:52.066710 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:52.067154 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:52.217471 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:52.226412 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:52.228069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:52.229331 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af997437-ed96-4135-a8bb-6e31f2fdcc23 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.432292 May 26 18:15:52.229881 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 523/1091] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:51 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:53.248296 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:53.248916 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:53.255616 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:53.256070 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:53.256842 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:53.257284 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:53.387018 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:53.395754 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:53.397266 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:53.398487 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9cfba23-e5b5-445f-a74c-1eca9c723ee9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.154094 May 26 18:15:53.399055 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 569/1092] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:53 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:53.545604 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-67856683-b5fa-4078-b3da-9aae8e6ec280 req-6f16cfc0-bcf5-42f7-8689-025059354dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "name": "network-vif-plugged", "status": "completed", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:53.557045 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-67856683-b5fa-4078-b3da-9aae8e6ec280 req-6f16cfc0-bcf5-42f7-8689-025059354dba service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:53.557509 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-67856683-b5fa-4078-b3da-9aae8e6ec280 req-6f16cfc0-bcf5-42f7-8689-025059354dba service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:53.561657 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:53.571631 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-67856683-b5fa-4078-b3da-9aae8e6ec280 req-6f16cfc0-bcf5-42f7-8689-025059354dba service nova] Creating event network-vif-plugged:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:15:53.577122 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-67856683-b5fa-4078-b3da-9aae8e6ec280 req-6f16cfc0-bcf5-42f7-8689-025059354dba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035106 May 26 18:15:53.577908 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 524/1093] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:54.416655 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:54.417203 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:54.423752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:54.424300 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:54.425115 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:54.425562 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:54.555909 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:54.563829 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:54.566172 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:54.567389 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f811a75-8575-47ca-830e-2ebc77cc9de9 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.154701 May 26 18:15:54.567945 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 570/1094] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:54 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:15:55.587389 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:55.588323 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:55.597422 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:55.598266 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:55.599069 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:55.599516 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:55.735858 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:55.744441 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:55.746110 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:55.747239 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4a643daf-47e3-4182-8e13-91d39ead068b tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1731 microversion: 2.20 time: 0.164946 May 26 18:15:55.747800 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 525/1095] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:55 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:15:56.765606 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:56.766256 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:56.773318 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:56.773773 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:56.774840 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:56.775289 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:56.907500 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:56.916328 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:56.917871 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:56.919067 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5791b8f5-6ce1-43ff-a4d9-09ab609f15e7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1718 microversion: 2.20 time: 0.157397 May 26 18:15:56.919630 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 571/1096] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:15:56 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:16:27.475461 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:27.476401 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:27.478737 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=11 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.480338 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.485705 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.486344 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.486984 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.487478 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.521499 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-39e9704a-75e6-4063-865e-57baec52e07c tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050196 May 26 18:16:27.522076 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 526/1097] 10.222.0.76 () {60 vars in 1342 bytes} [Thu May 26 18:16:27 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:27.596398 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:27.597000 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:27.599404 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=13 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.600636 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=29 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.607054 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.607512 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.608290 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.608731 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.644237 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:16:27.741683 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81d8e307-fe9a-429f-99df-16ca1d89576d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 204 len: 0 microversion: 2.20 time: 0.154349 May 26 18:16:27.742552 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 572/1098] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 26 18:16:27 2022] DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 18:16:27.753413 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:27.755234 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:27.761252 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.761706 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.762498 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.762937 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.907254 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:27.915552 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:27.917112 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:27.918382 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f1aa127-e223-4f16-9fdc-3af5ee8e0784 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.170826 May 26 18:16:27.918943 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 527/1099] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:27 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:16:28.941264 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:28.942511 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:28.949177 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.949633 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:28.950440 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.950884 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:29.085327 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:29.093208 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:29.094742 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:29.095894 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc619837-702f-49e2-a4dc-23aeef93b407 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1724 microversion: 2.20 time: 0.158960 May 26 18:16:29.096451 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 573/1100] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:28 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:16:30.012037 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-ba2d2e80-6732-4d82-b05b-b5580b442de7 req-b46a481d-f58a-47e8-9e5e-d763899f6bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b179d75-fc35-42af-8ef7-b7a38b7992e2", "name": "network-vif-deleted", "tag": "0dee4d26-9746-4489-a773-a054c63b2c40"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:30.022549 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ba2d2e80-6732-4d82-b05b-b5580b442de7 req-b46a481d-f58a-47e8-9e5e-d763899f6bfe service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.022993 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-ba2d2e80-6732-4d82-b05b-b5580b442de7 req-b46a481d-f58a-47e8-9e5e-d763899f6bfe service nova] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.038997 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-ba2d2e80-6732-4d82-b05b-b5580b442de7 req-b46a481d-f58a-47e8-9e5e-d763899f6bfe service nova] Creating event network-vif-deleted:0dee4d26-9746-4489-a773-a054c63b2c40 for instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 on hv-cinder-83906 May 26 18:16:30.045378 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-ba2d2e80-6732-4d82-b05b-b5580b442de7 req-b46a481d-f58a-47e8-9e5e-d763899f6bfe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037683 May 26 18:16:30.046071 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 528/1101] 10.222.0.76 () {64 vars in 1317 bytes} [Thu May 26 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:30.115495 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:30.116879 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:30.124112 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.124696 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.125553 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.126062 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.164150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.164611 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.165078 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lazy-loading 'fault' on Instance uuid 6b179d75-fc35-42af-8ef7-b7a38b7992e2 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:16:30.209463 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:30.221746 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:30.224363 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b262e67242c4384ba5bf0356a08679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b13e82b890d4bedbd8ecb6bcbd603c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:30.226052 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7692fd46-d4ad-412b-9a95-d4b366224937 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 200 len: 1372 microversion: 2.20 time: 0.115613 May 26 18:16:30.226673 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 574/1102] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:30 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:16:31.247809 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:31.248547 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:31.255903 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.256358 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:31.257141 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.257685 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:31.272042 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 HTTP/1.1 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:16:31.273689 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:31.275776 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '6b179d75-fc35-42af-8ef7-b7a38b7992e2'} May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:31.276798 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:31.278391 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:31.280057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:31.280057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-91f699d1-e28f-4fbd-a5ae-b769265830a3 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 404 len: 111 microversion: 2.20 time: 0.031929 May 26 18:16:31.280057 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 529/1103] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:31 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:16:31.284682 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-63cf0815-d90f-41e3-95cb-09d42cc9b21d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '.version_select at 0x7f1fa4da2c10>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:31.288386 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63cf0815-d90f-41e3-95cb-09d42cc9b21d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [6730e74f-a493-4241-ae9d-543f81d431ec] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:16:32.295961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [None req-63cf0815-d90f-41e3-95cb-09d42cc9b21d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [6730e74f-a493-4241-ae9d-543f81d431ec] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 41842. May 26 18:16:32.317230 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-63cf0815-d90f-41e3-95cb-09d42cc9b21d tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660816782" status: 204 len: 0 microversion: 2.20 time: 1.036570 May 26 18:16:32.317834 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 575/1104] 10.222.0.76 () {60 vars in 1261 bytes} [Thu May 26 18:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660816782 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:16:34.080222 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:34.080733 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:34.087534 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.087989 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.088765 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.089211 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.105001 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 HTTP/1.1 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:16:34.106591 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.108280 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '6b179d75-fc35-42af-8ef7-b7a38b7992e2'} May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:34.111872 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.113397 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:34.115739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:34.115739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e594246f-412d-40db-bee2-1d0b2d50b703 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 404 len: 111 microversion: 2.20 time: 0.031638 May 26 18:16:34.115739 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 530/1105] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 26 18:16:34 2022] DELETE /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:16:34.117634 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:34.118281 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6b179d75-fc35-42af-8ef7-b7a38b7992e2] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:34.125330 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.125787 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.126588 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.127028 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.140490 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 HTTP/1.1 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:16:34.142150 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.143918 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '6b179d75-fc35-42af-8ef7-b7a38b7992e2'} May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:34.145513 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. May 26 18:16:34.147858 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:34.149544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6b179d75-fc35-42af-8ef7-b7a38b7992e2 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:34.149544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dbf9790d-4791-4014-82e4-88e207b4c621 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2" status: 404 len: 111 microversion: 2.20 time: 0.031014 May 26 18:16:34.149544 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 576/1106] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:34 2022] GET /compute/v2.1/servers/6b179d75-fc35-42af-8ef7-b7a38b7992e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:16:35.278787 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:35.279321 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:35.285882 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.286365 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.288319 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.288769 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.302270 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b HTTP/1.1 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept: application/json May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Connection: close May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Length: 0 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Content-Type: application/json May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Host: 10.222.0.76 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Id: None May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Domain-Name: None May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Role: reader,member May 26 18:16:35.305106 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Roles: reader,member May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: method: > May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: exception: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.306877 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: action_args: {'id': '6fabdc26-1a43-41bd-849f-797ba0e5b73b'} May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:35.307796 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.309387 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi May 26 18:16:35.311654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:35.311654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ec4053a-3c5a-4d50-89c2-f58d25c95521 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 404 len: 111 microversion: 2.20 time: 0.031626 May 26 18:16:35.311654 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 531/1107] 10.222.0.76 () {60 vars in 1279 bytes} [Thu May 26 18:16:35 2022] DELETE /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:16:35.315098 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:35.315722 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] [instance: 6fabdc26-1a43-41bd-849f-797ba0e5b73b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:35.322469 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.322925 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.323695 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.324138 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Lock "0b0db0dc-c451-4016-9cfb-3e1d6c7c5950" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.337429 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] HTTP exception thrown: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Request method failure captured: May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b HTTP/1.1 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept: application/json May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Connection: close May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Length: 0 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Content-Type: application/json May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Host: 10.222.0.76 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABij8Kr27393Ogu0L4ZS-7cMtqh9FlO5dipl-Cz0f8AKI8U2xT_xtOWRz8QhXsJRHGM8NkxWmi8oKzisB2Yji8ewrPajh7Pzg8ac64FK722r385LQl_38YzmyAwTZ4Pi2gcF5EzFzm-D3frJ4jt95Z4V7OlwQwGu9yhLR697Lqpr2-4Kbs May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Id: None May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Domain-Name: None May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Role: reader,member May 26 18:16:35.339021 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Roles: reader,member May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b13e82b890d4bedbd8ecb6bcbd603c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 1b13e82b890d4bedbd8ecb6bcbd603c6 May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-486978805 May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Id: 1b262e67242c4384ba5bf0356a08679e May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-486978805-project May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: method: > May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: exception: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.340833 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: action_args: {'id': '6fabdc26-1a43-41bd-849f-797ba0e5b73b'} May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:35.341752 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. May 26 18:16:35.343294 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi May 26 18:16:35.344646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] Returning 404 to user: Instance 6fabdc26-1a43-41bd-849f-797ba0e5b73b could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:35.344646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d06b0aca-fd8d-47a1-88a8-a43c129115a7 tempest-AttachVolumeShelveTestJSON-486978805 tempest-AttachVolumeShelveTestJSON-486978805-project] 10.222.0.76 "GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b" status: 404 len: 111 microversion: 2.20 time: 0.029238 May 26 18:16:35.344646 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 577/1108] 10.222.0.76 () {60 vars in 1276 bytes} [Thu May 26 18:16:35 2022] GET /compute/v2.1/servers/6fabdc26-1a43-41bd-849f-797ba0e5b73b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:18:07.158079 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:18:07.158613 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Thu May 26 18:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:18:16.894814 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:18:16.895587 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Thu May 26 18:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:18:35.351481 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:18:35.352043 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Thu May 26 18:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:27.167096 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:27.167568 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Thu May 26 18:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:36.903961 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:36.904640 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Thu May 26 18:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:43.864213 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:43.864758 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Thu May 26 18:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:45.209790 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:45.210341 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Thu May 26 18:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:55.359961 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:55.360794 dv-cinder-839064-2-iscsi devstack@n-api.service[117832]: Thu May 26 18:21:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:59.119385 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:59.119857 dv-cinder-839064-2-iscsi devstack@n-api.service[117833]: Thu May 26 18:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!